Nov 03 16:54:02 devstack cinder-volume[75230]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 16:54:02 devstack cinder-volume[75230]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 16:54:02 devstack cinder-volume[75230]: we strongly recommend against using it for new projects. Nov 03 16:54:02 devstack cinder-volume[75230]: If you are already using Eventlet, we recommend migrating to a different Nov 03 16:54:02 devstack cinder-volume[75230]: framework. For more detail see Nov 03 16:54:02 devstack cinder-volume[75230]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 16:54:02 devstack cinder-volume[75230]: import eventlet # noqa Nov 03 16:54:05 devstack cinder-volume[75230]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:54:05 devstack cinder-volume[75230]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:54:05 devstack cinder-volume[75230]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:54:06 devstack cinder-volume[75230]: INFO dbcounter [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Registered counter for database cinder Nov 03 16:54:06 devstack cinder-volume[75230]: DEBUG oslo_db.sqlalchemy.engines [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:54:06 devstack cinder-volume[75230]: DEBUG dbcounter [-] [75230] Writer thread running {{(pid=75230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:54:06 devstack cinder-volume[75230]: INFO cinder.rpc [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 16:54:06 devstack cinder-volume[75230]: INFO cinder.rpc [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 16:54:06 devstack cinder-volume[75230]: DEBUG oslo_db.sqlalchemy.engines [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:54:06 devstack cinder-volume[75230]: INFO cinder.volume.manager [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Determined volume DB was empty at startup. Nov 03 16:54:06 devstack cinder-volume[75230]: DEBUG cinder.volume.manager [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75230) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 16:54:06 devstack cinder-volume[75230]: INFO cinder.volume.manager [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 16:54:06 devstack cinder-volume[75230]: WARNING stevedore.named [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 16:54:06 devstack cinder-volume[75230]: WARNING castellan.key_manager [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:54:06 devstack cinder-volume[75230]: WARNING cinder.keymgr.conf_key_mgr [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:54:06 devstack cinder-volume[75230]: DEBUG cinder.volume.drivers.lvm [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75230) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 16:54:06 devstack cinder-volume[75230]: DEBUG oslo_concurrency.processutils [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_concurrency.processutils [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.423s {{(pid=75230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_db.sqlalchemy.engines [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:54:07 devstack cinder-volume[75230]: INFO cinder.rpc [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 16:54:07 devstack cinder-volume[75230]: INFO cinder.rpc [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 16:54:07 devstack cinder-volume[75230]: WARNING stevedore.named [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 16:54:07 devstack cinder-volume[75230]: WARNING castellan.key_manager [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:54:07 devstack cinder-volume[75230]: INFO cinder.volume.manager [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_db.sqlalchemy.engines [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:54:07 devstack cinder-volume[75230]: INFO oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Starting 1 workers Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Started child 75375 {{(pid=75230) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Full set of CONF: {{(pid=75230) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] ******************************************************************************** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Configuration options gathered from: {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] ================================================================================ {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 16:54:07 devstack cinder-volume[75375]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] allow_availability_zone_fallback = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] allow_compression_on_image_upload = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] allowed_direct_url_schemes = [] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] api_rate_limit = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] auth_strategy = keystone {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] az_cache_duration = 3600 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_availability_zone = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_host = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_name = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_stats_polling_interval = 60 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backup_api_class = cinder.backup.api.API {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backup_name_template = backup-%s {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backup_use_same_host = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backup_use_temp_snapshot = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] chap_password = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] chap_username = {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cinder_internal_tenant_project_id = 03a63e1d2f844f8493a92354b73c9f64 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cinder_internal_tenant_user_id = 9b2243b8befa40a69f6c6d4e390135a2 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cloned_volume_same_az = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cluster = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] compression_format = gzip {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] compute_api_class = cinder.compute.nova.API {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] config_dir = [] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] config_source = [] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] control_exchange = openstack {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] debug = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] default_availability_zone = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] default_group_type = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] default_volume_type = lvmdriver-1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] disk_geometry = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] driver_client_cert = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] driver_client_cert_key = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] driver_data_namespace = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] driver_ssl_cert_path = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] driver_ssl_cert_verify = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] driver_use_ssl = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] enable_force_upload = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] enable_new_services = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] enable_unsupported_driver = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] enforce_multipath_for_image_xfer = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] filter_function = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance_api_insecure = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance_api_servers = ['http://192.168.122.39/image'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance_api_ssl_compression = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance_ca_certificates_file = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance_catalog_info = image:glance:publicURL {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance_certfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance_keyfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance_num_retries = 3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance_request_timeout = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] goodness_function = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] graceful_shutdown_timeout = 5 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] group_api_class = cinder.group.api.API {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] host = devstack {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_compress_on_upload = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_conversion_address_space_limit = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_conversion_cpu_limit = 60 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_conversion_disable = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_introspection_address_space_limit = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_introspection_cpu_limit = 60 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_upload_use_cinder_backend = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_upload_use_internal_tenant = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_volume_cache_enabled = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_volume_cache_max_count = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] image_volume_cache_max_size_gb = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] init_host_max_objects_retrieval = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] instance_format = [instance: %(uuid)s] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] iscsi_target_flags = {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] iscsi_write_cache = on {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] iser_helper = tgtadm {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] iser_ip_address = 192.168.122.39 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] iser_port = 3260 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] log_color = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] log_config_append = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] log_dir = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] log_file = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] log_options = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] log_rotate_interval = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] log_rotate_interval_type = days {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] log_rotation_type = none {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] max_age = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] max_logfile_count = 30 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] max_logfile_size_mb = 200 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] max_over_subscription_ratio = 20.0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] message_reap_interval = 86400 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] message_ttl = 2592000 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] migration_create_volume_timeout_secs = 300 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] monkey_patch = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] monkey_patch_modules = [] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] my_ip = 192.168.122.39 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] no_snapshot_gb_quota = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] num_iser_scan_tries = 3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] num_shell_tries = 3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] num_volume_device_scan_tries = 3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] nvmeof_conn_info_version = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] nvmet_ns_id = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] nvmet_port_id = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] osapi_max_limit = 1000 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] osapi_volume_ext_list = [] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] osapi_volume_listen_port = 8776 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] osapi_volume_use_ssl = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] osapi_volume_workers = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] per_volume_size_limit = -1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75375]: INFO cinder.volume.manager [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] periodic_fuzzy_delay = 60 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] periodic_interval = 60 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] public_endpoint = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] publish_errors = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] quota_backup_gigabytes = 1000 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] quota_backups = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] quota_gigabytes = 1000 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] quota_groups = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] quota_snapshots = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] quota_volumes = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] rate_limit_burst = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] rate_limit_except_level = CRITICAL {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] rate_limit_interval = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] reinit_driver_count = 3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] replication_device = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] report_discard_supported = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] report_interval = 120 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] reservation_clean_interval = 86400 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] reservation_expire = 86400 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] reserved_image_namespaces = [] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] reserved_percentage = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] rpc_response_timeout = 120 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] run_external_periodic_tasks = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] scst_target_driver = iscsi {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] scst_target_iqn_name = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_down_time = 720 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] shell_completion = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] snapshot_name_template = snapshot-%s {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:07 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] snapshot_same_host = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] split_loggers = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] state_path = /opt/stack/data/cinder {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] storage_availability_zone = nova {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] storage_protocol = iSCSI {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] syslog_log_facility = LOG_USER {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] target_helper = lioadm {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] target_ip_address = 192.168.122.39 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] target_port = 3260 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] target_protocol = iscsi {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] target_secondary_ip_addresses = [] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] trace_flags = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] transport_url = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] until_refresh = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] use_chap_auth = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] use_default_quota_class = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] use_journal = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] use_json = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] use_multipath_for_image_xfer = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] use_stderr = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] use_syslog = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] verify_glance_signatures = enabled {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_api_class = cinder.volume.api.API {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_backend_name = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_clear = zero {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_clear_ionice = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_clear_size = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_copy_bps_limit = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:07 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_dd_blocksize = 1M {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_name_template = volume-%s {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_service_inithost_offload = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volume_usage_audit_period = month {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] zoning_mode = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.auth_section = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.auth_type = password {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.auth_version = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.cache = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.certfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.include_service_catalog = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.insecure = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.interface = public {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.keyfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_password = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcache_username = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.region_name = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.service_type = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.39/identity {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.backend = dogpile.cache.null {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.backend_argument = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.backend_expiration_time = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.config_prefix = cache.oslo {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.debug_cache_backend = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack sudo[75411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.enable_retry_client = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.enable_socket_keepalive = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.enabled = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.expiration_time = 600 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack sudo[75411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.memcache_dead_retry = 300 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.memcache_pool_maxsize = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.memcache_sasl_enabled = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.password = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.proxies = [] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.redis_db = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.redis_server = localhost:6379 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.retry_attempts = 2 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.retry_delay = 0.0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.socket_keepalive_count = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.socket_keepalive_idle = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.socket_keepalive_interval = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.socket_timeout = 1.0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.tls_allowed_ciphers = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.tls_cafile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.tls_certfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.tls_enabled = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.tls_keyfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cache.username = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] coordination.backend_url = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.asyncio_connection = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.asyncio_slave_connection = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.backend = sqlalchemy {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.connection = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.connection_debug = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.connection_parameters = {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.connection_recycle_time = 3600 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.connection_trace = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.db_inc_retry_interval = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.db_max_retries = 20 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.db_max_retry_interval = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.db_retry_interval = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.max_overflow = 50 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.max_pool_size = 5 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.max_retries = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.pool_timeout = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.retry_interval = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.slave_connection = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.sqlite_synchronous = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.synchronous_reader = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] database.use_db_reconnect = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_tracing.insecure = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler.connection_string = messaging:// {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler.enabled = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler.es_doc_type = notification {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler.es_scroll_size = 10000 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler.es_scroll_time = 2m {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler.filter_error_trace = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler.hmac_keys = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler.sentinel_service_name = mymaster {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler.socket_timeout = 0.1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler.trace_requests = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler.trace_sqlalchemy = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler_jaeger.process_tags = {} {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] profiler_otlp.service_name_prefix = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_policy.enforce_new_defaults = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_policy.policy_default_rule = default {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_policy.policy_file = policy.yaml {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] privsep_osbrick.group = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] privsep_osbrick.helper_command = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] privsep_osbrick.user = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cinder_sys_admin.group = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cinder_sys_admin.helper_command = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] cinder_sys_admin.user = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.auth_section = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.auth_type = password {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.cafile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.certfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.collect_timing = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.insecure = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.keyfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.send_service_user_token = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.split_loggers = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.timeout = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.tls_ciphers = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] service_user.tls_min_version = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.auth_section = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.auth_type = password {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.certfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.collect_timing = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.insecure = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.keyfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.region_name = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.split_loggers = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.timeout = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.tls_ciphers = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] glance.tls_min_version = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.backend_availability_zone = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.chap_password = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.chap_username = {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.disk_geometry = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.driver_client_cert = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.driver_client_cert_key = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.driver_data_namespace = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.driver_use_ssl = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.extra_capabilities = {} {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.filter_function = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.goodness_function = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.iscsi_target_flags = {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.iscsi_write_cache = on {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.iser_helper = tgtadm {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.iser_ip_address = 192.168.122.39 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.iser_port = 3260 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.lvm_share_target = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.lvm_type = auto {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.num_shell_tries = 3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.replication_device = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.report_discard_supported = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.reserved_percentage = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.target_helper = tgtadm {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.target_ip_address = 192.168.122.39 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.target_port = 3260 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.target_protocol = iscsi {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.trace_flags = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.unique_fqdn_network = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.use_chap_auth = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.volume_backend_name = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.volume_clear = zero {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.volume_clear_ionice = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.volume_clear_size = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_reports.file_event_handler = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_reports.log_dir = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.backend_host = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.chap_password = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.chap_username = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.disk_geometry = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.driver_client_cert = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.extra_capabilities = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.filter_function = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.goodness_function = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.iser_helper = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.iser_ip_address = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.iser_port = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.lvm_share_target = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.lvm_type = auto {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.num_shell_tries = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.replication_device = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.report_discard_supported = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.reserved_percentage = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.scst_target_driver = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.storage_protocol = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.target_helper = lioadm {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.target_ip_address = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.target_port = 3260 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.trace_flags = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.use_chap_auth = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.volume_clear = zero {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.volume_clear_size = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] lvmdriver-1.volumes_dir = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.ssl = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_notifications.driver = [] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] key_manager.fixed_key = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.barbican_api_version = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.barbican_endpoint = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.barbican_endpoint_type = public {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.barbican_region_name = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.cafile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.certfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.collect_timing = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.insecure = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.keyfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.number_of_retries = 60 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.retry_delay = 1 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.send_service_user_token = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.split_loggers = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.timeout = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.tls_ciphers = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.tls_min_version = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.verify_ssl = True {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican.verify_ssl_path = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican_service_user.auth_section = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican_service_user.auth_type = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican_service_user.cafile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican_service_user.certfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican_service_user.collect_timing = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican_service_user.insecure = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican_service_user.keyfile = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican_service_user.split_loggers = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican_service_user.timeout = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican_service_user.tls_ciphers = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] barbican_service_user.tls_min_version = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.approle_role_id = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.approle_secret_id = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.auth_method = approle {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.auth_path = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.kv_mountpoint = secret {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.kv_path = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.kv_version = 2 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.namespace = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.root_token_id = **** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.ssl_ca_crt_file = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.timeout = 60.0 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.token_file = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.token_role = None {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.use_ssl = False {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:54:07 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] ******************************************************************************** {{(pid=75230) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 16:54:08 devstack sudo[75411]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:08 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.386s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:08 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:08 devstack sudo[75564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:54:08 devstack sudo[75564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:08 devstack sudo[75564]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:08 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.284s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:08 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 16:54:08 devstack cinder-volume[75375]: INFO cinder.brick.local_dev.lvm [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 16:54:08 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:08 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:08 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:08 devstack sudo[75671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:54:08 devstack sudo[75671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:08 devstack sudo[75671]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:08 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:08 devstack cinder-volume[75375]: DEBUG cinder.brick.local_dev.lvm [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75375) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 16:54:08 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:08 devstack sudo[75751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:54:08 devstack sudo[75751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:09 devstack sudo[75751]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:09 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:09 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:09 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:09 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:09 devstack sudo[75980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:54:09 devstack sudo[75980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:09 devstack sudo[75980]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:09 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:09 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:09 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:09 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:09 devstack sudo[75984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 16:54:09 devstack sudo[75984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:09 devstack sudo[75984]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:09 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.315s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:09 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:09 devstack sudo[76068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:54:09 devstack sudo[76068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:10 devstack sudo[76068]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:10 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:10 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:10 devstack sudo[76077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:54:10 devstack sudo[76077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:10 devstack sudo[76077]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:10 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:10 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:10 devstack sudo[76160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:54:10 devstack sudo[76160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:10 devstack sudo[76160]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:10 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:10 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:10 devstack sudo[76163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:54:10 devstack sudo[76163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:11 devstack sudo[76163]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:11 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:11 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:11 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:11 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:11 devstack sudo[76167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:54:11 devstack sudo[76167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:11 devstack sudo[76167]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:11 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:11 devstack cinder-volume[75375]: INFO cinder.volume.drivers.lvm [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 16:54:11 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:11 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:11 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:11 devstack sudo[76171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:54:11 devstack sudo[76171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:11 devstack sudo[76171]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:11 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:11 devstack cinder-volume[75375]: DEBUG cinder.volume.drivers.lvm [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Updating volume stats {{(pid=75375) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:54:11 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:11 devstack sudo[76180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:54:11 devstack sudo[76180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:12 devstack sudo[76180]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:12 devstack sudo[76183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:54:12 devstack sudo[76183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:12 devstack sudo[76183]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:12 devstack sudo[76186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:54:12 devstack sudo[76186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:12 devstack sudo[76186]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:12 devstack sudo[76189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:54:12 devstack sudo[76189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:12 devstack sudo[76189]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:12 devstack cinder-volume[75375]: INFO cinder.volume.driver [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG cinder.volume.driver [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75375) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG oslo_db.sqlalchemy.engines [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75375) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG dbcounter [-] [75375] Writer thread running {{(pid=75375) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG cinder.db.api [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Building query based on filter {{(pid=75375) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG cinder.image.image_utils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75375) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 16:54:12 devstack cinder-volume[75375]: INFO cinder.keymgr.migration [None req-7444c5a8-c9d6-46a4-9c2b-def0d059fb09 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG cinder.volume.drivers.lvm [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Updating volume stats {{(pid=75375) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:54:12 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:12 devstack sudo[76195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:54:12 devstack sudo[76195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:13 devstack sudo[76195]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:13 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:13 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:13 devstack sudo[76198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:54:13 devstack sudo[76198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:13 devstack sudo[76198]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:13 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:13 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:13 devstack sudo[76201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:54:13 devstack sudo[76201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:13 devstack sudo[76201]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:13 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:13 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:13 devstack sudo[76204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:54:13 devstack sudo[76204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:14 devstack sudo[76204]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:14 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:14 devstack cinder-volume[75375]: DEBUG cinder.manager [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Notifying Schedulers of capabilities ... {{(pid=75375) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:54:14 devstack cinder-volume[75375]: INFO cinder.volume.manager [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Driver initialization completed successfully. Nov 03 16:54:14 devstack cinder-volume[75375]: INFO cinder.manager [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Initiating service 2 cleanup Nov 03 16:54:14 devstack cinder-volume[75375]: INFO cinder.manager [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Service 2 cleanup completed. Nov 03 16:54:14 devstack cinder-volume[75375]: DEBUG cinder.service [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Creating RPC server for service cinder-volume {{(pid=75375) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 16:54:14 devstack cinder-volume[75375]: DEBUG cinder.service [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75375) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 16:54:14 devstack cinder-volume[75375]: INFO cinder.volume.manager [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 16:54:14 devstack cinder-volume[75375]: DEBUG cinder.volume.drivers.lvm [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Updating volume stats {{(pid=75375) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:54:14 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:14 devstack sudo[76209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:54:14 devstack sudo[76209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:14 devstack sudo[76209]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:14 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:14 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:14 devstack sudo[76212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:54:14 devstack sudo[76212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:14 devstack sudo[76212]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:14 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:14 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:14 devstack sudo[76218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:54:14 devstack sudo[76218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:15 devstack sudo[76218]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:54:15 devstack sudo[76221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:54:15 devstack sudo[76221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:54:15 devstack sudo[76221]: pam_unix(sudo:session): session closed for user root Nov 03 16:54:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:54:15 devstack cinder-volume[75375]: INFO cinder.volume.manager [None req-34652b1c-47c2-4d9b-8a43-bdbf51a44c43 None None] Driver post RPC initialization completed successfully. Nov 03 16:54:15 devstack cinder-volume[75375]: DEBUG oslo_service.periodic_task [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running periodic task VolumeManager._thread_info {{(pid=75375) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:54:15 devstack cinder-volume[75375]: DEBUG cinder.volume.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] thread count: 6 {{(pid=75375) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:54:15 devstack cinder-volume[75375]: DEBUG cinder.volume.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] thread info: [<_MainThread(MainThread, started 123628858024064)>, , , , , ] {{(pid=75375) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:54:17 devstack cinder-volume[75230]: DEBUG dbcounter [-] [75230] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:54:25 devstack cinder-volume[75375]: DEBUG dbcounter [-] [75375] Writing DB stats cinder:SELECT=4 {{(pid=75375) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:54:25 devstack cinder-volume[75375]: DEBUG dbcounter [-] [75375] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75375) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:55:15 devstack cinder-volume[75375]: DEBUG oslo_service.periodic_task [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75375) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:55:15 devstack cinder-volume[75375]: DEBUG cinder.volume.drivers.lvm [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Updating volume stats {{(pid=75375) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:55:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:55:15 devstack sudo[78508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:55:15 devstack sudo[78508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:55:15 devstack sudo[78508]: pam_unix(sudo:session): session closed for user root Nov 03 16:55:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:55:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:55:15 devstack sudo[78511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:55:15 devstack sudo[78511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:55:15 devstack sudo[78511]: pam_unix(sudo:session): session closed for user root Nov 03 16:55:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:55:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:55:15 devstack sudo[78514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:55:15 devstack sudo[78514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:55:16 devstack sudo[78514]: pam_unix(sudo:session): session closed for user root Nov 03 16:55:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:55:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:55:16 devstack sudo[78517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:55:16 devstack sudo[78517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:55:16 devstack sudo[78517]: pam_unix(sudo:session): session closed for user root Nov 03 16:55:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:55:16 devstack cinder-volume[75375]: DEBUG cinder.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Notifying Schedulers of capabilities ... {{(pid=75375) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:55:16 devstack cinder-volume[75375]: DEBUG oslo_service.periodic_task [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running periodic task VolumeManager._thread_info {{(pid=75375) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:55:16 devstack cinder-volume[75375]: DEBUG cinder.volume.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] thread count: 6 {{(pid=75375) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:55:16 devstack cinder-volume[75375]: DEBUG cinder.volume.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] thread info: [<_MainThread(MainThread, started 123628858024064)>, , , , , ] {{(pid=75375) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:56:15 devstack cinder-volume[75375]: DEBUG oslo_service.periodic_task [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75375) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:56:15 devstack cinder-volume[75375]: DEBUG cinder.volume.drivers.lvm [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Updating volume stats {{(pid=75375) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:56:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:15 devstack sudo[81948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:56:15 devstack sudo[81948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:15 devstack sudo[81948]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:15 devstack sudo[81952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:56:15 devstack sudo[81952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:15 devstack sudo[81952]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:15 devstack sudo[81962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:56:15 devstack sudo[81962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:16 devstack sudo[81962]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:56:16 devstack sudo[81965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:56:16 devstack sudo[81965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:56:16 devstack sudo[81965]: pam_unix(sudo:session): session closed for user root Nov 03 16:56:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:56:16 devstack cinder-volume[75375]: DEBUG cinder.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Notifying Schedulers of capabilities ... {{(pid=75375) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:56:16 devstack cinder-volume[75375]: DEBUG oslo_service.periodic_task [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running periodic task VolumeManager._thread_info {{(pid=75375) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:56:16 devstack cinder-volume[75375]: DEBUG cinder.volume.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] thread count: 6 {{(pid=75375) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:56:16 devstack cinder-volume[75375]: DEBUG cinder.volume.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] thread info: [<_MainThread(MainThread, started 123628858024064)>, , , , , ] {{(pid=75375) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:56:25 devstack cinder-volume[75375]: DEBUG dbcounter [-] [75375] Writing DB stats cinder:SELECT=1 {{(pid=75375) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:56:25 devstack cinder-volume[75375]: DEBUG dbcounter [-] [75375] Writing DB stats cinder:UPDATE=1 {{(pid=75375) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:57:15 devstack cinder-volume[75375]: DEBUG oslo_service.periodic_task [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75375) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:57:15 devstack cinder-volume[75375]: DEBUG cinder.volume.drivers.lvm [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Updating volume stats {{(pid=75375) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:57:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:15 devstack sudo[84068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:57:15 devstack sudo[84068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:15 devstack sudo[84068]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:15 devstack sudo[84072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:57:15 devstack sudo[84072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:15 devstack sudo[84072]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:15 devstack sudo[84075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:57:15 devstack sudo[84075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:16 devstack sudo[84075]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:57:16 devstack sudo[84089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:57:16 devstack sudo[84089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:57:16 devstack sudo[84089]: pam_unix(sudo:session): session closed for user root Nov 03 16:57:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:57:16 devstack cinder-volume[75375]: DEBUG cinder.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Notifying Schedulers of capabilities ... {{(pid=75375) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:15 devstack cinder-volume[75375]: DEBUG oslo_service.periodic_task [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75375) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:58:15 devstack cinder-volume[75375]: DEBUG cinder.volume.drivers.lvm [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Updating volume stats {{(pid=75375) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 16:58:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:15 devstack sudo[85250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 16:58:15 devstack sudo[85250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:15 devstack sudo[85250]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:15 devstack sudo[85253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:58:15 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:15 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:15 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:16 devstack sudo[85257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 16:58:16 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:16 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:16 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 16:58:16 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:16 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:16 devstack cinder-volume[75375]: DEBUG oslo_concurrency.processutils [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:16 devstack cinder-volume[75375]: DEBUG cinder.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Notifying Schedulers of capabilities ... {{(pid=75375) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:16 devstack cinder-volume[75375]: DEBUG oslo_service.periodic_task [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] Running periodic task VolumeManager._thread_info {{(pid=75375) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:58:16 devstack cinder-volume[75375]: DEBUG cinder.volume.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] thread count: 6 {{(pid=75375) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:58:16 devstack cinder-volume[75375]: DEBUG cinder.volume.manager [None req-077e4020-f89a-45ad-a5c4-29a51a5bbc3b None None] thread info: [<_MainThread(MainThread, started 123628858024064)>, , , , , ] {{(pid=75375) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 16:58:25 devstack cinder-volume[75375]: DEBUG dbcounter [-] [75375] Writing DB stats cinder:SELECT=1 {{(pid=75375) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:58:25 devstack cinder-volume[75375]: DEBUG dbcounter [-] [75375] Writing DB stats cinder:UPDATE=1 {{(pid=75375) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:58:36 devstack cinder-volume[75230]: INFO oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Caught SIGTERM, stopping children Nov 03 16:58:36 devstack cinder-volume[75230]: DEBUG oslo_concurrency.lockutils [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Acquiring lock "singleton_lock" {{(pid=75230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:58:36 devstack cinder-volume[75230]: DEBUG oslo_concurrency.lockutils [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Acquired lock "singleton_lock" {{(pid=75230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:58:36 devstack cinder-volume[75230]: DEBUG oslo_concurrency.lockutils [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Releasing lock "singleton_lock" {{(pid=75230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:58:36 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Stop services. {{(pid=75230) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 16:58:36 devstack cinder-volume[75230]: DEBUG oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Killing children. {{(pid=75230) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 16:58:36 devstack cinder-volume[75230]: INFO oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Waiting on 1 children to exit Nov 03 16:58:39 devstack cinder-volume[75375]: DEBUG oslo_concurrency.lockutils [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Acquiring lock "singleton_lock" {{(pid=75375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:58:39 devstack cinder-volume[75375]: DEBUG oslo_concurrency.lockutils [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Acquired lock "singleton_lock" {{(pid=75375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:58:39 devstack cinder-volume[75375]: DEBUG oslo_concurrency.lockutils [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Releasing lock "singleton_lock" {{(pid=75375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:58:39 devstack cinder-volume[75375]: WARNING amqp [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 16:58:39 devstack cinder-volume[75375]: WARNING amqp [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 16:58:39 devstack cinder-volume[75230]: INFO oslo_service.backend._eventlet.service [None req-ad869903-6ae9-40ae-9c6a-712349b1d4c7 None None] Child 75375 exited with status 0 Nov 03 16:58:39 devstack cinder-volume[85781]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 16:58:39 devstack cinder-volume[85781]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 16:58:39 devstack cinder-volume[85781]: we strongly recommend against using it for new projects. Nov 03 16:58:39 devstack cinder-volume[85781]: If you are already using Eventlet, we recommend migrating to a different Nov 03 16:58:39 devstack cinder-volume[85781]: framework. For more detail see Nov 03 16:58:39 devstack cinder-volume[85781]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 16:58:39 devstack cinder-volume[85781]: import eventlet # noqa Nov 03 16:58:41 devstack cinder-volume[85781]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85781) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:58:41 devstack cinder-volume[85781]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85781) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:58:41 devstack cinder-volume[85781]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85781) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:58:42 devstack cinder-volume[85781]: INFO dbcounter [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Registered counter for database cinder Nov 03 16:58:42 devstack cinder-volume[85781]: DEBUG oslo_db.sqlalchemy.engines [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85781) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG dbcounter [-] [85781] Writer thread running {{(pid=85781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:58:43 devstack cinder-volume[85781]: INFO cinder.rpc [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 16:58:43 devstack cinder-volume[85781]: INFO cinder.rpc [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_db.sqlalchemy.engines [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85781) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:58:43 devstack cinder-volume[85781]: INFO cinder.volume.manager [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Determined volume DB was empty at startup. Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG cinder.volume.manager [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85781) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 16:58:43 devstack cinder-volume[85781]: INFO cinder.volume.manager [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 16:58:43 devstack cinder-volume[85781]: WARNING stevedore.named [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 16:58:43 devstack cinder-volume[85781]: WARNING castellan.key_manager [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:58:43 devstack cinder-volume[85781]: WARNING cinder.keymgr.conf_key_mgr [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:58:43 devstack cinder-volume[85781]: INFO cinder.volume.manager [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_db.sqlalchemy.engines [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85781) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:58:43 devstack cinder-volume[85781]: INFO oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Starting 1 workers Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Started child 86044 {{(pid=85781) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Full set of CONF: {{(pid=85781) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] ******************************************************************************** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Configuration options gathered from: {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] ================================================================================ {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 16:58:43 devstack cinder-volume[86044]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] allow_availability_zone_fallback = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] allow_compression_on_image_upload = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] allowed_direct_url_schemes = [] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] api_rate_limit = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] auth_strategy = keystone {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_availability_zone = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_host = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_name = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_stats_polling_interval = 60 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backup_api_class = cinder.backup.api.API {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backup_name_template = backup-%s {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backup_use_same_host = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backup_use_temp_snapshot = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] chap_password = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] chap_username = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cinder_internal_tenant_project_id = 03a63e1d2f844f8493a92354b73c9f64 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cinder_internal_tenant_user_id = 9b2243b8befa40a69f6c6d4e390135a2 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cluster = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] compression_format = gzip {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] compute_api_class = cinder.compute.nova.API {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] config_dir = [] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] config_source = [] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] control_exchange = openstack {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] debug = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] default_availability_zone = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] default_group_type = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] default_volume_type = QuobyteHD {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] disk_geometry = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] driver_client_cert = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] driver_client_cert_key = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] driver_data_namespace = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] driver_ssl_cert_path = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] driver_ssl_cert_verify = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] driver_use_ssl = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] enable_new_services = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] enable_unsupported_driver = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] enabled_backends = ['QuobyteHD'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] enforce_multipath_for_image_xfer = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] filter_function = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance_api_insecure = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance_api_servers = ['http://192.168.122.39/image'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance_api_ssl_compression = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance_ca_certificates_file = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance_catalog_info = image:glance:publicURL {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance_certfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance_keyfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance_num_retries = 3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[86044]: INFO cinder.volume.manager [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 16:58:43 devstack cinder-volume[86044]: DEBUG cinder.volume.drivers.remotefs [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86044) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance_request_timeout = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] goodness_function = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] graceful_shutdown_timeout = 5 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] group_api_class = cinder.group.api.API {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] host = devstack {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_compress_on_upload = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_conversion_address_space_limit = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_conversion_cpu_limit = 60 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_conversion_disable = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_introspection_address_space_limit = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_introspection_cpu_limit = 60 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_upload_use_cinder_backend = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_upload_use_internal_tenant = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_volume_cache_enabled = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_volume_cache_max_count = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] image_volume_cache_max_size_gb = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] init_host_max_objects_retrieval = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] instance_format = [instance: %(uuid)s] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] iscsi_target_flags = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] iscsi_write_cache = on {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] iser_helper = tgtadm {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] iser_ip_address = 192.168.122.39 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] iser_port = 3260 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] log_color = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] log_config_append = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] log_dir = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] log_file = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] log_options = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] log_rotate_interval = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] log_rotate_interval_type = days {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] log_rotation_type = none {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] max_age = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] max_logfile_count = 30 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] max_logfile_size_mb = 200 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] max_over_subscription_ratio = 20.0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] message_reap_interval = 86400 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] message_ttl = 2592000 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] migration_create_volume_timeout_secs = 300 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] monkey_patch = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] monkey_patch_modules = [] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] my_ip = 192.168.122.39 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] no_snapshot_gb_quota = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] num_iser_scan_tries = 3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] num_shell_tries = 3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] num_volume_device_scan_tries = 3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] nvmeof_conn_info_version = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] nvmet_ns_id = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] nvmet_port_id = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] osapi_max_limit = 1000 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] osapi_volume_ext_list = [] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[86044]: DEBUG cinder.volume.drivers.quobyte [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86044) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] osapi_volume_listen_port = 8776 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] osapi_volume_use_ssl = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] osapi_volume_workers = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] per_volume_size_limit = -1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] periodic_fuzzy_delay = 60 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[86044]: WARNING cinder.volume.drivers.quobyte [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] periodic_interval = 60 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[86044]: WARNING cinder.volume.drivers.quobyte [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] public_endpoint = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] publish_errors = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] quota_backup_gigabytes = 1000 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] quota_backups = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] quota_gigabytes = 1000 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] quota_groups = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] quota_snapshots = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Running cmd (subprocess): mount.quobyte {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] quota_volumes = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] rate_limit_burst = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] rate_limit_except_level = CRITICAL {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] rate_limit_interval = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] reinit_driver_count = 3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] replication_device = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] report_discard_supported = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] report_interval = 120 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] reservation_clean_interval = 86400 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] reservation_expire = 86400 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] reserved_image_namespaces = [] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] reserved_percentage = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] rpc_response_timeout = 120 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] run_external_periodic_tasks = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] scst_target_driver = iscsi {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] scst_target_iqn_name = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_down_time = 720 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] shell_completion = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] snapshot_name_template = snapshot-%s {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] split_loggers = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] state_path = /opt/stack/data/cinder {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] storage_availability_zone = nova {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] storage_protocol = iSCSI {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] syslog_log_facility = LOG_USER {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] target_helper = lioadm {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] target_ip_address = 192.168.122.39 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] target_port = 3260 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] target_protocol = iscsi {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] target_secondary_ip_addresses = [] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] trace_flags = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] transport_url = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] until_refresh = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] use_chap_auth = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] use_default_quota_class = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] use_journal = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] use_json = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] use_multipath_for_image_xfer = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] use_stderr = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] use_syslog = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] verify_glance_signatures = enabled {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_api_class = cinder.volume.api.API {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_backend_name = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_clear = zero {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_clear_ionice = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_clear_size = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_copy_bps_limit = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_dd_blocksize = 1M {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_name_template = volume-%s {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_service_inithost_offload = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volume_usage_audit_period = month {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] zoning_mode = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_concurrency.disable_process_locking = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.auth_section = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.auth_type = password {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.auth_version = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.cache = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.certfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.include_service_catalog = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.insecure = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.interface = public {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.keyfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_password = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcache_username = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.region_name = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.service_type = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.39/identity {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.backend = dogpile.cache.null {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.backend_argument = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.backend_expiration_time = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.config_prefix = cache.oslo {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.debug_cache_backend = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.enable_retry_client = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.enable_socket_keepalive = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.enabled = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.expiration_time = 600 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.hashclient_retry_attempts = 2 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.memcache_dead_retry = 300 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.memcache_pool_maxsize = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.memcache_sasl_enabled = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.password = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.proxies = [] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.redis_db = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.redis_server = localhost:6379 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.retry_attempts = 2 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.retry_delay = 0.0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.socket_keepalive_count = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.socket_keepalive_idle = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.socket_keepalive_interval = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.socket_timeout = 1.0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.tls_allowed_ciphers = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.tls_cafile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.tls_certfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.tls_enabled = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.tls_keyfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cache.username = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] coordination.backend_url = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.asyncio_connection = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.asyncio_slave_connection = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.backend = sqlalchemy {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.connection = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.connection_debug = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.connection_parameters = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.connection_recycle_time = 3600 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.connection_trace = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.db_inc_retry_interval = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.db_max_retries = 20 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.db_max_retry_interval = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.db_retry_interval = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.max_overflow = 50 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.max_pool_size = 5 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.max_retries = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.mysql_wsrep_sync_wait = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.pool_timeout = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.retry_interval = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.slave_connection = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.sqlite_synchronous = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.synchronous_reader = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] database.use_db_reconnect = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_tracing.insecure = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler.connection_string = messaging:// {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler.enabled = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler.es_doc_type = notification {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler.es_scroll_size = 10000 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler.es_scroll_time = 2m {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler.filter_error_trace = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler.hmac_keys = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler.sentinel_service_name = mymaster {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler.socket_timeout = 0.1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler.trace_requests = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler.trace_sqlalchemy = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler_jaeger.process_tags = {} {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler_jaeger.service_name_prefix = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] profiler_otlp.service_name_prefix = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_policy.enforce_new_defaults = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_policy.policy_default_rule = default {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_policy.policy_file = policy.yaml {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] privsep_osbrick.group = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] privsep_osbrick.helper_command = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] privsep_osbrick.user = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cinder_sys_admin.group = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cinder_sys_admin.helper_command = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] cinder_sys_admin.user = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.auth_section = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.auth_type = password {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.cafile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.certfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.collect_timing = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.insecure = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.keyfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.send_service_user_token = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.split_loggers = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.timeout = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.tls_ciphers = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] service_user.tls_min_version = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.auth_section = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.auth_type = password {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.certfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.collect_timing = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.insecure = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.keyfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.region_name = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack quobyte-client[86045]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.split_loggers = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.timeout = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.tls_ciphers = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] glance.tls_min_version = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.backend_availability_zone = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack quobyte-client[86045]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.chap_password = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.chap_username = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.disk_geometry = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.driver_client_cert = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.driver_client_cert_key = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.driver_data_namespace = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.driver_use_ssl = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.extra_capabilities = {} {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.filter_function = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.goodness_function = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] CMD "mount.quobyte" returned: 1 in 0.130s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[86044]: DEBUG cinder.volume.drivers.quobyte [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.iscsi_target_flags = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.iscsi_write_cache = on {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.iser_helper = tgtadm {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.iser_ip_address = 192.168.122.39 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.iser_port = 3260 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nas_host = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nas_login = admin {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nas_mount_options = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nas_password = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nas_private_key = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nas_share_path = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[86044]: INFO cinder.volume.drivers.quobyte [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 ... Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 -c /etc/quobyte/client-cinder.cfg {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.num_shell_tries = 3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.quobyte_volume_url = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.replication_device = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.report_discard_supported = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.reserved_percentage = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.target_helper = tgtadm {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.target_ip_address = 192.168.122.39 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.target_port = 3260 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.target_protocol = iscsi {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.trace_flags = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.unique_fqdn_network = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.use_chap_auth = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.volume_backend_name = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.volume_clear = zero {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.volume_clear_ionice = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.volume_clear_size = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_reports.file_event_handler = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_reports.log_dir = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.backend_availability_zone = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.backend_host = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.chap_password = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.chap_username = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.chiscsi_conf = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.disk_geometry = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.driver_client_cert = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.driver_data_namespace = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.driver_use_ssl = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.extra_capabilities = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.filter_function = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.goodness_function = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.iser_helper = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.iser_ip_address = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.iser_port = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.iser_target_prefix = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nas_host = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nas_login = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nas_mount_options = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nas_password = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nas_private_key = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nas_share_path = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nas_ssh_port = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.num_shell_tries = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.nvmet_port_id = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.replication_device = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.report_discard_supported = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.reserved_percentage = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.scst_target_driver = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.storage_protocol = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.target_helper = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.target_ip_address = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.target_port = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.target_prefix = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.target_protocol = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.trace_flags = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.use_chap_auth = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.volume_clear = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.volume_clear_size = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] QuobyteHD.volumes_dir = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack sudo[86048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 -c /etc/quobyte/client-cinder.cfg Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.ssl = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_notifications.driver = [] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_notifications.retry = -1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] key_manager.fixed_key = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.barbican_api_version = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.barbican_endpoint = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.barbican_endpoint_type = public {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.barbican_region_name = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.cafile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.certfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.collect_timing = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.insecure = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.keyfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.number_of_retries = 60 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.retry_delay = 1 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.send_service_user_token = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.split_loggers = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.timeout = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.tls_ciphers = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.tls_min_version = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.verify_ssl = True {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican.verify_ssl_path = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican_service_user.auth_section = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican_service_user.auth_type = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican_service_user.cafile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican_service_user.certfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican_service_user.collect_timing = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican_service_user.insecure = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican_service_user.keyfile = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican_service_user.split_loggers = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican_service_user.timeout = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican_service_user.tls_ciphers = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] barbican_service_user.tls_min_version = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.approle_role_id = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.approle_secret_id = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.auth_method = approle {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.auth_path = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.kv_mountpoint = secret {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.kv_path = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.kv_version = 2 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.namespace = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.root_token_id = **** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.ssl_ca_crt_file = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.timeout = 60.0 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.token_file = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.token_role = None {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.use_ssl = False {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:43 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] ******************************************************************************** {{(pid=85781) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 16:58:44 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.530s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:44 devstack cinder-volume[86044]: INFO cinder.volume.drivers.quobyte [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 succeeded Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG cinder.volume.drivers.quobyte [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.557s {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:44 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 16:58:44 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:44 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.252s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:44 devstack cinder-volume[86044]: INFO cinder.volume.driver [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG cinder.volume.driver [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5803260803223, 'free_capacity_gb': 1773.5803260803223, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86044) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG oslo_db.sqlalchemy.engines [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG dbcounter [-] [86044] Writer thread running {{(pid=86044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG cinder.db.api [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Building query based on filter {{(pid=86044) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG cinder.image.image_utils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86044) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 16:58:44 devstack cinder-volume[86044]: INFO cinder.keymgr.migration [None req-cf7c7030-c622-4ada-ae5e-d91ffa737c72 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG cinder.volume.drivers.quobyte [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG cinder.volume.drivers.quobyte [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:44 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:44 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 16:58:44 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:45 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:45 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.283s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:45 devstack cinder-volume[86044]: DEBUG cinder.manager [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Notifying Schedulers of capabilities ... {{(pid=86044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:45 devstack cinder-volume[86044]: INFO cinder.volume.manager [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Driver initialization completed successfully. Nov 03 16:58:45 devstack cinder-volume[86044]: INFO cinder.manager [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Initiating service 3 cleanup Nov 03 16:58:45 devstack cinder-volume[86044]: INFO cinder.manager [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Service 3 cleanup completed. Nov 03 16:58:45 devstack cinder-volume[86044]: DEBUG cinder.service [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Creating RPC server for service cinder-volume {{(pid=86044) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 16:58:45 devstack cinder-volume[86044]: DEBUG cinder.service [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86044) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 16:58:45 devstack cinder-volume[86044]: INFO cinder.volume.manager [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 16:58:45 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:45 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:45 devstack cinder-volume[86044]: DEBUG cinder.volume.drivers.quobyte [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:45 devstack cinder-volume[86044]: DEBUG cinder.volume.drivers.quobyte [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:45 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:45 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:45 devstack sudo[86157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 16:58:45 devstack sudo[86157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:45 devstack sudo[86157]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:45 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.255s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:45 devstack cinder-volume[86044]: INFO cinder.volume.manager [None req-65f37395-9c58-4850-81b8-3d3b1f00b8a4 None None] Driver post RPC initialization completed successfully. Nov 03 16:58:49 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-a5f16ac8-2720-4c90-a96b-fd3f57d5dfac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:49 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-a5f16ac8-2720-4c90-a96b-fd3f57d5dfac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:49 devstack cinder-volume[86044]: DEBUG cinder.volume.drivers.quobyte [None req-a5f16ac8-2720-4c90-a96b-fd3f57d5dfac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86044) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:50 devstack cinder-volume[86044]: DEBUG cinder.volume.drivers.quobyte [None req-a5f16ac8-2720-4c90-a96b-fd3f57d5dfac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86044) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:50 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-a5f16ac8-2720-4c90-a96b-fd3f57d5dfac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86044) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:50 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-a5f16ac8-2720-4c90-a96b-fd3f57d5dfac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:50 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 16:58:50 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:50 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:50 devstack cinder-volume[86044]: DEBUG oslo_concurrency.processutils [None req-a5f16ac8-2720-4c90-a96b-fd3f57d5dfac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.256s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:50 devstack cinder-volume[86044]: DEBUG cinder.manager [None req-a5f16ac8-2720-4c90-a96b-fd3f57d5dfac None None] Notifying Schedulers of capabilities ... {{(pid=86044) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:58:51 devstack cinder-volume[85781]: INFO oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Caught SIGTERM, stopping children Nov 03 16:58:51 devstack cinder-volume[85781]: DEBUG oslo_concurrency.lockutils [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Acquiring lock "singleton_lock" {{(pid=85781) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:58:51 devstack cinder-volume[85781]: DEBUG oslo_concurrency.lockutils [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Acquired lock "singleton_lock" {{(pid=85781) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:58:51 devstack cinder-volume[85781]: DEBUG oslo_concurrency.lockutils [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Releasing lock "singleton_lock" {{(pid=85781) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:58:51 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Stop services. {{(pid=85781) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 16:58:51 devstack cinder-volume[85781]: DEBUG oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Killing children. {{(pid=85781) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 16:58:51 devstack cinder-volume[85781]: INFO oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Waiting on 1 children to exit Nov 03 16:58:53 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Acquiring lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:58:53 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Acquired lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:58:53 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Releasing lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:58:53 devstack cinder-volume[86044]: WARNING amqp [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 16:58:53 devstack cinder-volume[86044]: WARNING amqp [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 16:58:53 devstack cinder-volume[85781]: INFO oslo_service.backend._eventlet.service [None req-6448d1fb-672c-4ee6-86f6-c8885c14e525 None None] Child 86044 exited with status 0 Nov 03 16:58:54 devstack cinder-volume[86357]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 16:58:54 devstack cinder-volume[86357]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 16:58:54 devstack cinder-volume[86357]: we strongly recommend against using it for new projects. Nov 03 16:58:54 devstack cinder-volume[86357]: If you are already using Eventlet, we recommend migrating to a different Nov 03 16:58:54 devstack cinder-volume[86357]: framework. For more detail see Nov 03 16:58:54 devstack cinder-volume[86357]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 16:58:54 devstack cinder-volume[86357]: import eventlet # noqa Nov 03 16:58:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86357) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 16:58:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86357) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 16:58:57 devstack cinder-volume[86357]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86357) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 16:58:58 devstack cinder-volume[86357]: INFO dbcounter [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Registered counter for database cinder Nov 03 16:58:58 devstack cinder-volume[86357]: DEBUG oslo_db.sqlalchemy.engines [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86357) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writer thread running {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:58:59 devstack cinder-volume[86357]: INFO cinder.rpc [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 16:58:59 devstack cinder-volume[86357]: INFO cinder.rpc [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_db.sqlalchemy.engines [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86357) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:58:59 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Determined volume DB was empty at startup. Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG cinder.volume.manager [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86357) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 16:58:59 devstack cinder-volume[86357]: WARNING stevedore.named [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 16:58:59 devstack cinder-volume[86357]: WARNING castellan.key_manager [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:58:59 devstack cinder-volume[86357]: WARNING cinder.keymgr.conf_key_mgr [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 16:58:59 devstack cinder-volume[86357]: INFO cinder.volume.manager [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_db.sqlalchemy.engines [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86357) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:58:59 devstack cinder-volume[86357]: INFO oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Starting 1 workers Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Started child 86661 {{(pid=86357) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Full set of CONF: {{(pid=86357) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] ******************************************************************************** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] Configuration options gathered from: {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] ================================================================================ {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] allow_availability_zone_fallback = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] allow_compression_on_image_upload = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] allowed_direct_url_schemes = [] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] api_rate_limit = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] auth_strategy = keystone {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_availability_zone = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_host = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86661]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_name = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_stats_polling_interval = 60 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backup_api_class = cinder.backup.api.API {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backup_name_template = backup-%s {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backup_use_same_host = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backup_use_temp_snapshot = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] chap_password = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] chap_username = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cinder_internal_tenant_project_id = 03a63e1d2f844f8493a92354b73c9f64 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cinder_internal_tenant_user_id = 9b2243b8befa40a69f6c6d4e390135a2 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cluster = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] compression_format = gzip {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] compute_api_class = cinder.compute.nova.API {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] config_dir = [] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] config_source = [] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] control_exchange = openstack {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] debug = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] default_availability_zone = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] default_group_type = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] default_volume_type = QuobyteHD {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] disk_geometry = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] driver_client_cert = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] driver_client_cert_key = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] driver_data_namespace = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] driver_ssl_cert_path = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] driver_ssl_cert_verify = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] driver_use_ssl = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] enable_new_services = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] enable_unsupported_driver = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] enabled_backends = ['QuobyteHD'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] enforce_multipath_for_image_xfer = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] filter_function = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance_api_insecure = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance_api_servers = ['http://192.168.122.39/image'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance_api_ssl_compression = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance_ca_certificates_file = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance_catalog_info = image:glance:publicURL {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance_certfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance_keyfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance_num_retries = 3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance_request_timeout = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] goodness_function = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] graceful_shutdown_timeout = 5 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] group_api_class = cinder.group.api.API {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] host = devstack {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_compress_on_upload = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_conversion_address_space_limit = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_conversion_cpu_limit = 60 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_conversion_disable = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_introspection_address_space_limit = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_introspection_cpu_limit = 60 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_upload_use_cinder_backend = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_upload_use_internal_tenant = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_volume_cache_enabled = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_volume_cache_max_count = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] image_volume_cache_max_size_gb = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] init_host_max_objects_retrieval = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] instance_format = [instance: %(uuid)s] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] iscsi_target_flags = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] iscsi_write_cache = on {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] iser_helper = tgtadm {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] iser_ip_address = 192.168.122.39 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] iser_port = 3260 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] log_color = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] log_config_append = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] log_dir = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] log_file = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] log_options = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] log_rotate_interval = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] log_rotate_interval_type = days {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] log_rotation_type = none {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] max_age = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] max_logfile_count = 30 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] max_logfile_size_mb = 200 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] max_over_subscription_ratio = 20.0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] message_reap_interval = 86400 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] message_ttl = 2592000 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] migration_create_volume_timeout_secs = 300 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] monkey_patch = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] monkey_patch_modules = [] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] my_ip = 192.168.122.39 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] no_snapshot_gb_quota = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] num_iser_scan_tries = 3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] num_shell_tries = 3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] num_volume_device_scan_tries = 3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] nvmeof_conn_info_version = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] nvmet_ns_id = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] nvmet_port_id = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] osapi_max_limit = 1000 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] osapi_volume_ext_list = [] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] osapi_volume_listen = 0.0.0.0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] osapi_volume_listen_port = 8776 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] osapi_volume_use_ssl = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] osapi_volume_workers = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] per_volume_size_limit = -1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] periodic_fuzzy_delay = 60 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] periodic_interval = 60 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] project_id_regex = [0-9a-f\-]+ {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] public_endpoint = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] publish_errors = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] quota_backup_gigabytes = 1000 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] quota_backups = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] quota_gigabytes = 1000 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] quota_groups = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] quota_snapshots = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] quota_volumes = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] rate_limit_burst = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] rate_limit_except_level = CRITICAL {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] rate_limit_interval = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] reinit_driver_count = 3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] replication_device = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] report_discard_supported = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] report_interval = 120 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] reservation_clean_interval = 86400 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] reservation_expire = 86400 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] reserved_image_namespaces = [] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] reserved_percentage = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] rpc_response_timeout = 120 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] run_external_periodic_tasks = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] scst_target_driver = iscsi {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] scst_target_iqn_name = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_down_time = 720 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] shell_completion = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] snapshot_name_template = snapshot-%s {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] split_loggers = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] state_path = /opt/stack/data/cinder {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] storage_availability_zone = nova {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] storage_protocol = iSCSI {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] syslog_log_facility = LOG_USER {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] target_helper = lioadm {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] target_ip_address = 192.168.122.39 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] target_port = 3260 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] target_protocol = iscsi {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] target_secondary_ip_addresses = [] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] trace_flags = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] transfer_api_class = cinder.transfer.api.API {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] transport_url = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] until_refresh = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] use_chap_auth = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] use_default_quota_class = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] use_journal = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] use_json = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] use_multipath_for_image_xfer = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] use_stderr = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] use_syslog = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] verify_glance_signatures = enabled {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_api_class = cinder.volume.api.API {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_backend_name = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_clear = zero {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_clear_ionice = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_clear_size = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_copy_bps_limit = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_dd_blocksize = 1M {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_name_template = volume-%s {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_service_inithost_offload = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volume_usage_audit_period = month {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] zoning_mode = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 16:58:59 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_concurrency.disable_process_locking = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86661) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.auth_section = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.auth_type = password {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.auth_version = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.cache = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.certfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.delay_auth_decision = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.http_connect_timeout = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.include_service_catalog = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.insecure = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.interface = public {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.keyfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_password = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcache_username = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.region_name = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.service_token_roles_required = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.service_type = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.token_cache_time = 300 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.39/identity {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.backend = dogpile.cache.null {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.backend_argument = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.backend_expiration_time = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.config_prefix = cache.oslo {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.debug_cache_backend = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.enable_retry_client = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.enable_socket_keepalive = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.enabled = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.expiration_time = 600 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.hashclient_retry_attempts = 2 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.memcache_dead_retry = 300 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.memcache_pool_maxsize = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.memcache_sasl_enabled = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.password = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.proxies = [] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.redis_db = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.redis_sentinel_service_name = mymaster {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.redis_server = localhost:6379 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.retry_attempts = 2 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.retry_delay = 0.0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.socket_keepalive_count = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.socket_keepalive_idle = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.socket_keepalive_interval = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.socket_timeout = 1.0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.tls_allowed_ciphers = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.tls_cafile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.tls_certfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.tls_enabled = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.tls_keyfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cache.username = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] coordination.backend_url = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.asyncio_connection = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.asyncio_slave_connection = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.backend = sqlalchemy {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.connection = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.connection_debug = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.connection_parameters = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.connection_recycle_time = 3600 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.connection_trace = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.db_inc_retry_interval = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.db_max_retries = 20 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.db_max_retry_interval = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.db_retry_interval = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.max_overflow = 50 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.max_pool_size = 5 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.max_retries = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.mysql_wsrep_sync_wait = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.pool_timeout = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.retry_interval = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.slave_connection = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.sqlite_synchronous = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.synchronous_reader = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] database.use_db_reconnect = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_tracing.insecure = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler.connection_string = messaging:// {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler.enabled = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler.es_doc_type = notification {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler.es_scroll_size = 10000 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler.es_scroll_time = 2m {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler.filter_error_trace = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler.hmac_keys = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler.sentinel_service_name = mymaster {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler.socket_timeout = 0.1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler.trace_requests = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler.trace_sqlalchemy = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler_jaeger.process_tags = {} {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler_jaeger.service_name_prefix = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] profiler_otlp.service_name_prefix = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_policy.enforce_new_defaults = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_policy.policy_default_rule = default {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_policy.policy_file = policy.yaml {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_policy.remote_timeout = 60.0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] privsep_osbrick.group = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] privsep_osbrick.helper_command = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] privsep_osbrick.user = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cinder_sys_admin.group = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cinder_sys_admin.helper_command = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] cinder_sys_admin.user = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.auth_section = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.auth_type = password {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.cafile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.certfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.collect_timing = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.insecure = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.keyfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.send_service_user_token = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.split_loggers = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.timeout = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.tls_ciphers = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] service_user.tls_min_version = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.auth_section = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.auth_type = password {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.certfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.collect_timing = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.insecure = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.keyfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.region_name = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.split_loggers = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.timeout = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.tls_ciphers = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] glance.tls_min_version = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.backend_availability_zone = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.chap_password = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.chap_username = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.disk_geometry = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.driver_client_cert = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.driver_client_cert_key = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.driver_data_namespace = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.driver_use_ssl = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.enable_unsupported_driver = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.extra_capabilities = {} {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.filter_function = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.goodness_function = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.iscsi_target_flags = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.iscsi_write_cache = on {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.iser_helper = tgtadm {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.iser_ip_address = 192.168.122.39 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.iser_port = 3260 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nas_host = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nas_login = admin {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nas_mount_options = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nas_password = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nas_private_key = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nas_share_path = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nas_ssh_port = 22 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.num_shell_tries = 3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.nvmet_port_id = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.quobyte_client_cfg = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.quobyte_volume_url = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.replication_device = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.report_discard_supported = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.reserved_percentage = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.scst_target_driver = iscsi {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.scst_target_iqn_name = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.storage_protocol = iSCSI {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.target_helper = tgtadm {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.target_ip_address = 192.168.122.39 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.target_port = 3260 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.target_protocol = iscsi {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.trace_flags = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.unique_fqdn_network = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.use_chap_auth = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.volume_backend_name = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.volume_clear = zero {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.volume_clear_ionice = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.volume_clear_size = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_reports.file_event_handler = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_reports.log_dir = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.backend_availability_zone = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.backend_host = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.chap_password = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.chap_username = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.chiscsi_conf = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.disk_geometry = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.driver_client_cert = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.driver_client_cert_key = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.driver_data_namespace = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.driver_use_ssl = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.extra_capabilities = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.filter_function = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.goodness_function = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.iscsi_target_flags = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.iscsi_write_cache = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.iser_helper = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.iser_ip_address = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.iser_port = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.iser_target_prefix = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86661) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nas_host = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.quobyte [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 16:58:59 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.quobyte [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nas_login = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nas_mount_options = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nas_password = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nas_private_key = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nas_share_path = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nas_ssh_port = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Running cmd (subprocess): mount.quobyte {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.num_shell_tries = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nvmet_ns_id = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.nvmet_port_id = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.replication_device = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.report_discard_supported = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.reserved_percentage = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.scst_target_driver = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.storage_protocol = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.target_helper = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.target_ip_address = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.target_port = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.target_prefix = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.target_protocol = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.trace_flags = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.unique_fqdn_network = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.use_chap_auth = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.volume_clear = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.volume_clear_ionice = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.volume_clear_size = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] QuobyteHD.volumes_dir = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.ssl = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.ssl_version = {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_notifications.driver = [] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_notifications.retry = -1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] oslo_messaging_notifications.transport_url = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] key_manager.fixed_key = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.barbican_api_version = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.barbican_endpoint = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.barbican_endpoint_type = public {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.barbican_region_name = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.cafile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.certfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.collect_timing = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.insecure = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.keyfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.number_of_retries = 60 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.retry_delay = 1 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.send_service_user_token = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.split_loggers = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.timeout = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.tls_ciphers = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.tls_min_version = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.verify_ssl = True {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican.verify_ssl_path = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican_service_user.auth_section = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican_service_user.auth_type = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican_service_user.cafile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican_service_user.certfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican_service_user.collect_timing = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican_service_user.insecure = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican_service_user.keyfile = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican_service_user.split_loggers = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican_service_user.timeout = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican_service_user.tls_ciphers = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] barbican_service_user.tls_min_version = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.approle_role_id = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.approle_secret_id = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.auth_method = approle {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.auth_path = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.kv_mountpoint = secret {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.kv_path = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.kv_version = 2 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.namespace = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.root_token_id = **** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.ssl_ca_crt_file = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.timeout = 60.0 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.token_file = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.token_role = None {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.use_ssl = False {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 16:58:59 devstack cinder-volume[86357]: DEBUG oslo_service.backend._eventlet.service [None req-6cfb242a-5924-4670-91b4-8d26bf4d1bee None None] ******************************************************************************** {{(pid=86357) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 16:58:59 devstack quobyte-client[86662]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 16:58:59 devstack quobyte-client[86662]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:58:59 devstack sudo[86663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 16:58:59 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:58:59 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.252s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:58:59 devstack cinder-volume[86661]: INFO cinder.volume.driver [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG cinder.volume.driver [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5803260803223, 'free_capacity_gb': 1773.5803260803223, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86661) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG oslo_db.sqlalchemy.engines [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 16:58:59 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writer thread running {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG cinder.db.api [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Building query based on filter {{(pid=86661) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86661) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:00 devstack cinder-volume[86661]: INFO cinder.keymgr.migration [None req-90412d73-8243-4cdf-86ad-d9d5928938d8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 16:59:00 devstack sudo[86676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 16:59:00 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:00 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.231s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 16:59:00 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Driver initialization completed successfully. Nov 03 16:59:00 devstack cinder-volume[86661]: INFO cinder.manager [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Initiating service 3 cleanup Nov 03 16:59:00 devstack cinder-volume[86661]: INFO cinder.manager [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Service 3 cleanup completed. Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG cinder.service [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Creating RPC server for service cinder-volume {{(pid=86661) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG cinder.service [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86661) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 16:59:00 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 16:59:00 devstack sudo[86679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 16:59:00 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 16:59:00 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root Nov 03 16:59:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.252s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 16:59:00 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5d66d619-4587-4668-b727-ccb333b93910 None None] Driver post RPC initialization completed successfully. Nov 03 16:59:09 devstack cinder-volume[86357]: DEBUG dbcounter [-] [86357] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86357) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:59:10 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=2 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:59:10 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 16:59:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 16:59:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 6 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 16:59:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Flow 'volume_create_manager' (91024132-7d95-401f-ba74-ad4c7ae32ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69446a35-84ef-499c-973b-9724c83d6e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69446a35-84ef-499c-973b-9724c83d6e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1089990801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29fd796e-deba-4d90-a8a8-01d256378b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a1c5d09328d4d7b85599a3aae20eb5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:02Z,use_quota=True,user_id='cb61f91591f14a9bbf12bd9bff85bfa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4d5d62-f930-4af1-a498-09d26b737d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4d5d62-f930-4af1-a498-09d26b737d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93bf9715-476b-4041-89dd-11f596121464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93bf9715-476b-4041-89dd-11f596121464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29fd796e-deba-4d90-a8a8-01d256378b4b', 'volume_name': 'volume-29fd796e-deba-4d90-a8a8-01d256378b4b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f72f75-6a2d-46d7-ac40-49bd5de65b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f72f75-6a2d-46d7-ac40-49bd5de65b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f29210-8ad6-4a05-b821-63bfaedcf940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:02 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Volume 29fd796e-deba-4d90-a8a8-01d256378b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29fd796e-deba-4d90-a8a8-01d256378b4b', 'volume_size': 1} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1089990801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29fd796e-deba-4d90-a8a8-01d256378b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a1c5d09328d4d7b85599a3aae20eb5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:02Z,use_quota=True,user_id='cb61f91591f14a9bbf12bd9bff85bfa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Creating volume 29fd796e-deba-4d90-a8a8-01d256378b4b {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:02 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:00:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:02 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b 1073741824 Nov 03 17:00:02 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:03 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b 1073741824" returned: 0 in 0.639s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:03 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b Nov 03 17:00:03 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:03 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b" returned: 0 in 0.329s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:00:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f29210-8ad6-4a05-b821-63bfaedcf940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29fd796e-deba-4d90-a8a8-01d256378b4b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5235156e-8070-477c-8d80-8c5e955819d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:03 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Volume volume-29fd796e-deba-4d90-a8a8-01d256378b4b (29fd796e-deba-4d90-a8a8-01d256378b4b): created successfully Nov 03 17:00:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5235156e-8070-477c-8d80-8c5e955819d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Flow 'volume_create_manager' (91024132-7d95-401f-ba74-ad4c7ae32ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:03 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-20dca424-1301-48ed-8530-406ff48d643e tempest-TaggedAttachmentsTest-658329929 None] Created volume successfully. Nov 03 17:00:13 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:00:13 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:00:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:00:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:29 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:00:29 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:30 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.655s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:00:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 6 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:00:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Flow 'volume_create_manager' (872ae53d-fd46-4191-9d61-5b5daddfefee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66a20fc-8d33-4ee9-b973-4fbc57da85c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66a20fc-8d33-4ee9-b973-4fbc57da85c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-669325238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8559208d-62ed-4c70-94ea-9f6df87cb37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572a31fad30048abbb8e859a6058e5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:31Z,use_quota=True,user_id='afd1fbff2f70453eaba33bc96c598ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c580fff-3d9c-40ad-bd32-3f430b55b013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c580fff-3d9c-40ad-bd32-3f430b55b013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f648c3aa-984e-488d-a290-48bdefd8873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f648c3aa-984e-488d-a290-48bdefd8873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8559208d-62ed-4c70-94ea-9f6df87cb37f', 'volume_name': 'volume-8559208d-62ed-4c70-94ea-9f6df87cb37f', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542f5964-fc49-4a24-bdd8-6b914f357cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542f5964-fc49-4a24-bdd8-6b914f357cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fb4038-3160-41f2-8a22-3babdd02e3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:31 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Volume 8559208d-62ed-4c70-94ea-9f6df87cb37f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8559208d-62ed-4c70-94ea-9f6df87cb37f', 'volume_size': 1} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-669325238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8559208d-62ed-4c70-94ea-9f6df87cb37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572a31fad30048abbb8e859a6058e5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:31Z,use_quota=True,user_id='afd1fbff2f70453eaba33bc96c598ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Creating volume 8559208d-62ed-4c70-94ea-9f6df87cb37f {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:31 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:00:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:31 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f 1073741824 Nov 03 17:00:31 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:32 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f 1073741824" returned: 0 in 0.845s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:32 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f Nov 03 17:00:32 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:32 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f" returned: 0 in 0.288s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:00:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fb4038-3160-41f2-8a22-3babdd02e3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8559208d-62ed-4c70-94ea-9f6df87cb37f', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e75076d-ff8f-45e6-9db3-ef1b20f0e04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:32 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Volume volume-8559208d-62ed-4c70-94ea-9f6df87cb37f (8559208d-62ed-4c70-94ea-9f6df87cb37f): created successfully Nov 03 17:00:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e75076d-ff8f-45e6-9db3-ef1b20f0e04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Flow 'volume_create_manager' (872ae53d-fd46-4191-9d61-5b5daddfefee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:32 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-65a9e237-7389-470a-b83d-90e1bd617040 tempest-VolumesAdminNegativeTest-1184238807 None] Created volume successfully. Nov 03 17:00:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Acquiring lock "cinder-8559208d-62ed-4c70-94ea-9f6df87cb37f-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Lock "cinder-8559208d-62ed-4c70-94ea-9f6df87cb37f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Acquiring lock "cinder-quobyte-8559208d-62ed-4c70-94ea-9f6df87cb37f" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:00:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Lock "cinder-quobyte-8559208d-62ed-4c70-94ea-9f6df87cb37f" acquired by "delete_volume" :: waited 0.053s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:00:34 devstack cinder-volume[86661]: INFO oslo.privsep.daemon [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvm8esfpi/privsep.sock'] Nov 03 17:00:34 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvm8esfpi/privsep.sock Nov 03 17:00:34 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:35 devstack cinder-volume[86661]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 17:00:35 devstack cinder-volume[86661]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 17:00:35 devstack cinder-volume[86661]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 17:00:35 devstack cinder-volume[86661]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 17:00:35 devstack cinder-volume[86661]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 17:00:35 devstack cinder-volume[86661]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 17:00:35 devstack cinder-volume[86661]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 17:00:35 devstack cinder-volume[86661]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 17:00:35 devstack cinder-volume[86661]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 17:00:36 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:36 devstack cinder-volume[86661]: INFO oslo.privsep.daemon [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Spawned new privsep daemon via rootwrap Nov 03 17:00:36 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Accepted privsep connection to /tmp/tmpvm8esfpi/privsep.sock {{(pid=86661) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 17:00:36 devstack cinder-volume[86661]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 17:00:36 devstack cinder-volume[86661]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 17:00:36 devstack cinder-volume[86661]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 17:00:36 devstack cinder-volume[86661]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87670 Nov 03 17:00:36 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd59ad25-6623-4ae7-9ba7-116399241996]: (2,) {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:36 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc7cab-4eb7-4144-8c16-0ea3764aeaa9]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:00:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:36 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f Nov 03 17:00:36 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:37 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f" returned: 0 in 0.961s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:37 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f Nov 03 17:00:37 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:37 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8559208d-62ed-4c70-94ea-9f6df87cb37f" returned: 0 in 0.707s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Lock "cinder-quobyte-8559208d-62ed-4c70-94ea-9f6df87cb37f" released by "delete_volume" :: held 3.921s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:38 devstack cinder-volume[86661]: WARNING cinder.quota [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:00:38 devstack cinder-volume[86661]: WARNING cinder.quota [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:00:38 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Created reservations ['3fee7ed3-cf66-4388-a4b9-ba18cc8bb4c4', 'e0ba35ab-1a89-47e7-ab35-8dd213914e17', '3337a9b0-0c6d-4907-b333-d30e97cb3fb9', '7b1d33c5-90a2-4a75-a8a7-5b03e89f5f74'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:00:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:38 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:00:38 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:39 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.860s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:39 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:00:39 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Deleted volume successfully. Nov 03 17:00:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-98ab4864-467d-469f-b575-fde35bbbec95 tempest-VolumesAdminNegativeTest-1184238807 None] Lock "cinder-8559208d-62ed-4c70-94ea-9f6df87cb37f-delete_volume" released by "delete_volume" :: held 5.382s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Flow 'volume_create_manager' (192d7a54-f93e-48c4-a502-338d892cc5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b817623c-97fa-4b4b-8be6-5f75e25d940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b817623c-97fa-4b4b-8be6-5f75e25d940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1641098823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9606fde-83f9-4fa0-872a-b020df6af714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b138537d3314c5f92f40832da9a4221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:44Z,use_quota=True,user_id='531c1152bef34b11a92cf2875b9bcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145850d3-40a2-47c1-986a-8ca2d120ca3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145850d3-40a2-47c1-986a-8ca2d120ca3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9291fd-f67c-4fc0-b240-5fd597b2b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9291fd-f67c-4fc0-b240-5fd597b2b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9606fde-83f9-4fa0-872a-b020df6af714', 'volume_name': 'volume-a9606fde-83f9-4fa0-872a-b020df6af714', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4009cc-a880-4d74-9618-4dfda1df6414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4009cc-a880-4d74-9618-4dfda1df6414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaea2772-4913-4733-8819-58edd0b705fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:43 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Volume a9606fde-83f9-4fa0-872a-b020df6af714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9606fde-83f9-4fa0-872a-b020df6af714', 'volume_size': 1} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1641098823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9606fde-83f9-4fa0-872a-b020df6af714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b138537d3314c5f92f40832da9a4221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:00:44Z,use_quota=True,user_id='531c1152bef34b11a92cf2875b9bcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Creating volume a9606fde-83f9-4fa0-872a-b020df6af714 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:00:43 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:00:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:43 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714 1073741824 Nov 03 17:00:43 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:44 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714 1073741824" returned: 0 in 0.621s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:00:44 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714 Nov 03 17:00:44 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:00:45 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Nov 03 17:00:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714" returned: 0 in 0.530s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:00:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:00:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaea2772-4913-4733-8819-58edd0b705fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9606fde-83f9-4fa0-872a-b020df6af714', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc87adf8-a1d2-4e0c-a013-159ceb82f6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:00:45 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Volume volume-a9606fde-83f9-4fa0-872a-b020df6af714 (a9606fde-83f9-4fa0-872a-b020df6af714): created successfully Nov 03 17:00:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc87adf8-a1d2-4e0c-a013-159ceb82f6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:00:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Flow 'volume_create_manager' (192d7a54-f93e-48c4-a502-338d892cc5a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:00:45 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-4e6d6a67-d42f-4887-b2c7-69fce7ff22ea tempest-AttachVolumeTestJSON-777155928 None] Created volume successfully. Nov 03 17:00:48 devstack cinder-volume[86661]: WARNING py.warnings [req-60b7eafb-98bd-46b5-974e-1bc02c9c426f req-555a4433-9e6b-4c36-a646-76f1ccd71c59 tempest-AttachVolumeTestJSON-777155928 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 03 17:00:48 devstack cinder-volume[86661]: .first() Nov 03 17:00:48 devstack cinder-volume[86661]: Nov 03 17:00:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-60b7eafb-98bd-46b5-974e-1bc02c9c426f req-555a4433-9e6b-4c36-a646-76f1ccd71c59 tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:00:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-60b7eafb-98bd-46b5-974e-1bc02c9c426f req-555a4433-9e6b-4c36-a646-76f1ccd71c59 tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:00:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-60b7eafb-98bd-46b5-974e-1bc02c9c426f req-555a4433-9e6b-4c36-a646-76f1ccd71c59 tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:00:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-60b7eafb-98bd-46b5-974e-1bc02c9c426f req-555a4433-9e6b-4c36-a646-76f1ccd71c59 tempest-AttachVolumeTestJSON-777155928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-a9606fde-83f9-4fa0-872a-b020df6af714', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46dd3e6f-8fe9-457b-8898-9c8e98e4ce66', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:00:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-60b7eafb-98bd-46b5-974e-1bc02c9c426f req-555a4433-9e6b-4c36-a646-76f1ccd71c59 tempest-AttachVolumeTestJSON-777155928 None] attachment_update completed successfully. Nov 03 17:00:58 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=20,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:00:58 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=11,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:01:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-ddda9465-1678-4d1c-92da-fee4ed55e93d req-8a116f57-d4c6-44cd-94b3-33ee56b4d966 tempest-TaggedAttachmentsTest-658329929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-ddda9465-1678-4d1c-92da-fee4ed55e93d req-8a116f57-d4c6-44cd-94b3-33ee56b4d966 tempest-TaggedAttachmentsTest-658329929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-ddda9465-1678-4d1c-92da-fee4ed55e93d req-8a116f57-d4c6-44cd-94b3-33ee56b4d966 tempest-TaggedAttachmentsTest-658329929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-ddda9465-1678-4d1c-92da-fee4ed55e93d req-8a116f57-d4c6-44cd-94b3-33ee56b4d966 tempest-TaggedAttachmentsTest-658329929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-29fd796e-deba-4d90-a8a8-01d256378b4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6a43e25-5692-4020-a997-0a84c310fa25', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:01:08 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-ddda9465-1678-4d1c-92da-fee4ed55e93d req-8a116f57-d4c6-44cd-94b3-33ee56b4d966 tempest-TaggedAttachmentsTest-658329929 None] attachment_update completed successfully. Nov 03 17:01:10 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:01:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Flow 'volume_create_manager' (cb6f9379-7c46-42ca-bd51-d6532dfeea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02657364-b702-459f-9051-70107f7035f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02657364-b702-459f-9051-70107f7035f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-277867312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74cddd7f-660a-4478-af42-4bc0dc43bf0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657479f1bb294f899dbaa17b12d07551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:11Z,use_quota=True,user_id='1cfefea1ed694104b17a14058c3f9fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fddff336-216a-4deb-8db3-727dec83978c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fddff336-216a-4deb-8db3-727dec83978c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f03e7f-05ea-46f7-ae0d-0d3f47ac9db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f03e7f-05ea-46f7-ae0d-0d3f47ac9db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74cddd7f-660a-4478-af42-4bc0dc43bf0b', 'volume_name': 'volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb410e8-a0a2-48f5-b656-f550904ce70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb410e8-a0a2-48f5-b656-f550904ce70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9a50e0-4c6b-4f42-bc7d-5cb1f50e803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:11 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Volume 74cddd7f-660a-4478-af42-4bc0dc43bf0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b', 'volume_size': 1} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-277867312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74cddd7f-660a-4478-af42-4bc0dc43bf0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='657479f1bb294f899dbaa17b12d07551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:01:11Z,use_quota=True,user_id='1cfefea1ed694104b17a14058c3f9fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Creating volume 74cddd7f-660a-4478-af42-4bc0dc43bf0b {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:01:11 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:01:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:11 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b 1073741824 Nov 03 17:01:11 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:12 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b 1073741824" returned: 0 in 0.979s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:12 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b Nov 03 17:01:12 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:12 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b" returned: 0 in 0.402s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:01:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9a50e0-4c6b-4f42-bc7d-5cb1f50e803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05abcf66-4482-4ec6-ace0-3582c6a2f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:01:12 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Volume volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b (74cddd7f-660a-4478-af42-4bc0dc43bf0b): created successfully Nov 03 17:01:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05abcf66-4482-4ec6-ace0-3582c6a2f382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:01:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Flow 'volume_create_manager' (cb6f9379-7c46-42ca-bd51-d6532dfeea28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:01:12 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ac71a63f-e950-423b-a796-a1b572a4475e tempest-DeleteServersTestJSON-1535037239 None] Created volume successfully. Nov 03 17:01:13 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-6ecc782c-fd39-4e60-93ea-a83fbbe406e6 req-732ae544-442d-435c-bd7d-9186bc67b05b tempest-TaggedAttachmentsTest-658329929 None] Terminate volume connection completed successfully. Nov 03 17:01:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-6ecc782c-fd39-4e60-93ea-a83fbbe406e6 req-732ae544-442d-435c-bd7d-9186bc67b05b tempest-TaggedAttachmentsTest-658329929 None] Deleting attachment b6a43e25-5692-4020-a997-0a84c310fa25. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:01:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-8b00ae23-0b8e-4664-a37e-969fb2366fe0 req-47db4c4d-282d-414b-a98f-dc4627cab585 tempest-DeleteServersTestJSON-1535037239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-8b00ae23-0b8e-4664-a37e-969fb2366fe0 req-47db4c4d-282d-414b-a98f-dc4627cab585 tempest-DeleteServersTestJSON-1535037239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-8b00ae23-0b8e-4664-a37e-969fb2366fe0 req-47db4c4d-282d-414b-a98f-dc4627cab585 tempest-DeleteServersTestJSON-1535037239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-8b00ae23-0b8e-4664-a37e-969fb2366fe0 req-47db4c4d-282d-414b-a98f-dc4627cab585 tempest-DeleteServersTestJSON-1535037239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32804884-a876-4d21-89b9-d77e38d6b4c2', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:01:14 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-8b00ae23-0b8e-4664-a37e-969fb2366fe0 req-47db4c4d-282d-414b-a98f-dc4627cab585 tempest-DeleteServersTestJSON-1535037239 None] attachment_update completed successfully. Nov 03 17:01:18 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-35415bad-7dbf-4491-ac14-a14b7f324610 req-3328ed3e-2473-4233-8217-91913ab71fc5 tempest-DeleteServersTestJSON-1535037239 None] Terminate volume connection completed successfully. Nov 03 17:01:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-35415bad-7dbf-4491-ac14-a14b7f324610 req-3328ed3e-2473-4233-8217-91913ab71fc5 tempest-DeleteServersTestJSON-1535037239 None] Deleting attachment 32804884-a876-4d21-89b9-d77e38d6b4c2. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:01:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Acquiring lock "cinder-74cddd7f-660a-4478-af42-4bc0dc43bf0b-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Lock "cinder-74cddd7f-660a-4478-af42-4bc0dc43bf0b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Acquiring lock "cinder-quobyte-74cddd7f-660a-4478-af42-4bc0dc43bf0b" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Lock "cinder-quobyte-74cddd7f-660a-4478-af42-4bc0dc43bf0b" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[955bd532-cb71-4905-948e-7c75e2e75e40]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:20 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b Nov 03 17:01:20 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:20 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b" returned: 0 in 0.384s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:20 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b Nov 03 17:01:20 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:20 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-74cddd7f-660a-4478-af42-4bc0dc43bf0b" returned: 0 in 0.278s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Lock "cinder-quobyte-74cddd7f-660a-4478-af42-4bc0dc43bf0b" released by "delete_volume" :: held 0.717s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Created reservations ['272c2e98-141d-4118-ae6f-31afbdb43f88', '70eb8d3f-6c59-4238-8e1e-c5131d823654', '98eba35a-9748-4256-b757-711cf7aaad50', '894e6f44-2b42-4a10-b39b-3ced4bbed4dd'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:20 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:01:20 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:21 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.351s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:21 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Deleted volume successfully. Nov 03 17:01:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-581057a3-0b4d-4ff8-9391-c0ba676ff1cb tempest-DeleteServersTestJSON-1535037239 None] Lock "cinder-74cddd7f-660a-4478-af42-4bc0dc43bf0b-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:29 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:01:29 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Acquiring lock "cinder-29fd796e-deba-4d90-a8a8-01d256378b4b-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Lock "cinder-29fd796e-deba-4d90-a8a8-01d256378b4b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Acquiring lock "cinder-quobyte-29fd796e-deba-4d90-a8a8-01d256378b4b" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Lock "cinder-quobyte-29fd796e-deba-4d90-a8a8-01d256378b4b" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:01:29 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.311s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:29 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:30 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[22adfb27-864a-4589-8f35-5acd5879ebf8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:01:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:30 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b Nov 03 17:01:30 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:30 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b" returned: 0 in 0.436s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:30 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b Nov 03 17:01:30 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:30 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-29fd796e-deba-4d90-a8a8-01d256378b4b" returned: 0 in 0.398s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Lock "cinder-quobyte-29fd796e-deba-4d90-a8a8-01d256378b4b" released by "delete_volume" :: held 0.922s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:31 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Created reservations ['4d423ef0-aa0e-4d84-9c93-6c178d9667be', 'dcd54d25-2e41-4294-ae7a-45caaed708c1', '7763d2cc-8f56-480e-ab23-ac4e7803e1e2', '0503ab46-7c8c-4a38-8480-c1e529180d45'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:01:31 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-ee12c5fa-2df4-443d-a330-c270cb15c54c req-bfacf69a-e246-462e-a365-026b4ca08d46 tempest-AttachVolumeTestJSON-777155928 None] Terminate volume connection completed successfully. Nov 03 17:01:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-ee12c5fa-2df4-443d-a330-c270cb15c54c req-bfacf69a-e246-462e-a365-026b4ca08d46 tempest-AttachVolumeTestJSON-777155928 None] Deleting attachment 46dd3e6f-8fe9-457b-8898-9c8e98e4ce66. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:01:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:01:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:01:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:01:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:01:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:01:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:01:31 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:01:31 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:01:31 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Nov 03 17:01:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.345s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:01:31 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:01:31 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Deleted volume successfully. Nov 03 17:01:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d021204f-06c0-448d-8cdb-3e432aef2d33 tempest-TaggedAttachmentsTest-658329929 None] Lock "cinder-29fd796e-deba-4d90-a8a8-01d256378b4b-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:01:41 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=29,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:01:41 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=28,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:02:17 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Flow 'volume_create_manager' (cb3e5adf-0a82-49ed-8e3f-d452e5873d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67df5be1-62c8-453f-8bb6-1f73a235477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67df5be1-62c8-453f-8bb6-1f73a235477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1271330393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414b9723-ca47-4dd4-812e-8fa54a880e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd93120db6e64032855ff3fbdeab0994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:18Z,use_quota=True,user_id='c5e8e041c45f4a819fc7ccc20aa2ce22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18e7cd5-3dd0-45ab-ba43-a45924e75ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18e7cd5-3dd0-45ab-ba43-a45924e75ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ab4d34-6928-4228-88da-09ae87d58a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ab4d34-6928-4228-88da-09ae87d58a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414b9723-ca47-4dd4-812e-8fa54a880e0e', 'volume_name': 'volume-414b9723-ca47-4dd4-812e-8fa54a880e0e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f717999-71c4-4c25-9a31-8c6ddc5b4cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f717999-71c4-4c25-9a31-8c6ddc5b4cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb7304a-fa92-47c6-ac10-7fabc51790a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:18 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Volume 414b9723-ca47-4dd4-812e-8fa54a880e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414b9723-ca47-4dd4-812e-8fa54a880e0e', 'volume_size': 1} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1271330393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414b9723-ca47-4dd4-812e-8fa54a880e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd93120db6e64032855ff3fbdeab0994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:18Z,use_quota=True,user_id='c5e8e041c45f4a819fc7ccc20aa2ce22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Creating volume 414b9723-ca47-4dd4-812e-8fa54a880e0e {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:18 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:18 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e 1073741824 Nov 03 17:02:18 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:18 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e 1073741824" returned: 0 in 0.533s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:18 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e Nov 03 17:02:18 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:18 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e" returned: 0 in 0.278s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb7304a-fa92-47c6-ac10-7fabc51790a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414b9723-ca47-4dd4-812e-8fa54a880e0e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceb5a4a-b9f8-441f-a9f1-527cfdb69005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:18 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Volume volume-414b9723-ca47-4dd4-812e-8fa54a880e0e (414b9723-ca47-4dd4-812e-8fa54a880e0e): created successfully Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ceb5a4a-b9f8-441f-a9f1-527cfdb69005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Flow 'volume_create_manager' (cb3e5adf-0a82-49ed-8e3f-d452e5873d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:18 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-abf92bdb-7550-4cf8-83d4-b4c35b0fd3c3 tempest-ServerActionsTestOtherA-894703843 None] Created volume successfully. Nov 03 17:02:28 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:02:28 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Flow 'volume_create_manager' (98918e9f-a2f5-4834-b38f-bd2e2dc76381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6704456f-51d4-4fdc-95d7-72c7ff6abbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6704456f-51d4-4fdc-95d7-72c7ff6abbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1142644784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952a6a8d-f05c-4842-8484-e59058bba44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae2873e7927419da93a2988fb5abe34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:29Z,use_quota=True,user_id='5d48828cd6804e73b70152731afb29c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f582ee58-0411-49d1-83e4-0ffd2575cce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f582ee58-0411-49d1-83e4-0ffd2575cce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3efaedd0-608d-49f1-9dc1-d32a22da180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3efaedd0-608d-49f1-9dc1-d32a22da180d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '952a6a8d-f05c-4842-8484-e59058bba44a', 'volume_name': 'volume-952a6a8d-f05c-4842-8484-e59058bba44a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f5737f-315e-4899-8c21-49218a014f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f5737f-315e-4899-8c21-49218a014f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79437057-827a-450e-9712-42757cfff3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:29 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Volume 952a6a8d-f05c-4842-8484-e59058bba44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-952a6a8d-f05c-4842-8484-e59058bba44a', 'volume_size': 1} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1142644784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952a6a8d-f05c-4842-8484-e59058bba44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae2873e7927419da93a2988fb5abe34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:29Z,use_quota=True,user_id='5d48828cd6804e73b70152731afb29c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Creating volume 952a6a8d-f05c-4842-8484-e59058bba44a {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:29 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:29 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a 1073741824 Nov 03 17:02:29 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:29 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:02:29 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:30 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 1.209s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:02:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:02:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 8 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:02:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:02:30 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a 1073741824" returned: 0 in 1.382s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:31 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a Nov 03 17:02:31 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:31 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a" returned: 0 in 0.364s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79437057-827a-450e-9712-42757cfff3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-952a6a8d-f05c-4842-8484-e59058bba44a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f6c583-9bb6-4178-a378-f2617cb7af30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:31 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Volume volume-952a6a8d-f05c-4842-8484-e59058bba44a (952a6a8d-f05c-4842-8484-e59058bba44a): created successfully Nov 03 17:02:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f6c583-9bb6-4178-a378-f2617cb7af30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Flow 'volume_create_manager' (98918e9f-a2f5-4834-b38f-bd2e2dc76381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:31 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-dadbbc41-2eb4-48df-81b9-1f3c2fdc2a22 tempest-AttachVolumeShelveTestJSON-649961911 None] Created volume successfully. Nov 03 17:02:41 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:02:41 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Flow 'volume_create_manager' (497faf96-a437-4a31-b7c1-dcebba941f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efb8556-b94c-4a14-9e4c-df2f90fa2bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efb8556-b94c-4a14-9e4c-df2f90fa2bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1812156274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f1b18c-8437-47ce-a150-6df0172aec77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3889f104425543afbd70323e8d99aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:46Z,use_quota=True,user_id='556e94ec99a54b70a06331ead96c6b49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bc33f3-8a5a-42ba-8a66-6c159982bf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bc33f3-8a5a-42ba-8a66-6c159982bf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226b5bc7-5dc1-468d-bb05-5af47d542265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226b5bc7-5dc1-468d-bb05-5af47d542265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70f1b18c-8437-47ce-a150-6df0172aec77', 'volume_name': 'volume-70f1b18c-8437-47ce-a150-6df0172aec77', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c1be88-4529-4b0d-ad5c-814cac44bada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c1be88-4529-4b0d-ad5c-814cac44bada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da2410f-b4cb-447e-8935-e3b732fead03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:46 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Volume 70f1b18c-8437-47ce-a150-6df0172aec77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70f1b18c-8437-47ce-a150-6df0172aec77', 'volume_size': 1} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1812156274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f1b18c-8437-47ce-a150-6df0172aec77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3889f104425543afbd70323e8d99aaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:02:46Z,use_quota=True,user_id='556e94ec99a54b70a06331ead96c6b49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Creating volume 70f1b18c-8437-47ce-a150-6df0172aec77 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:02:46 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:02:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:46 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77 1073741824 Nov 03 17:02:46 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:47 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77 1073741824" returned: 0 in 1.328s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:02:47 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77 Nov 03 17:02:47 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:02:48 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Nov 03 17:02:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77" returned: 0 in 0.546s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:02:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:02:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:02:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da2410f-b4cb-447e-8935-e3b732fead03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f1b18c-8437-47ce-a150-6df0172aec77', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade2cff7-62b6-4dca-965c-9c9b643b5fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:02:48 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Volume volume-70f1b18c-8437-47ce-a150-6df0172aec77 (70f1b18c-8437-47ce-a150-6df0172aec77): created successfully Nov 03 17:02:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade2cff7-62b6-4dca-965c-9c9b643b5fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:02:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Flow 'volume_create_manager' (497faf96-a437-4a31-b7c1-dcebba941f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:02:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-859f1e59-d98e-4432-bb42-e169f88a34ed tempest-ServerRescueNegativeTestJSON-1342060284 None] Created volume successfully. Nov 03 17:02:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-61662d81-a071-4b7d-b154-70cfac31f469 req-42a40d44-cbcb-42c5-8485-6b8c803a3d01 tempest-AttachVolumeShelveTestJSON-649961911 None] No connector for attachment 0efb74b9-af5d-46cf-bdca-59be3d44db4d; skipping storage backend terminate_connection call. {{(pid=86661) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 17:02:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-61662d81-a071-4b7d-b154-70cfac31f469 req-42a40d44-cbcb-42c5-8485-6b8c803a3d01 tempest-AttachVolumeShelveTestJSON-649961911 None] Deleting attachment 0efb74b9-af5d-46cf-bdca-59be3d44db4d. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:03:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Acquiring lock "cinder-70f1b18c-8437-47ce-a150-6df0172aec77-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Lock "cinder-70f1b18c-8437-47ce-a150-6df0172aec77-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Acquiring lock "cinder-quobyte-70f1b18c-8437-47ce-a150-6df0172aec77" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Lock "cinder-quobyte-70f1b18c-8437-47ce-a150-6df0172aec77" acquired by "delete_volume" :: waited 0.040s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:07 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b555dbe4-9ea0-4011-b4a2-352cfc295082]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:07 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77 Nov 03 17:03:07 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:08 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77" returned: 0 in 0.839s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:08 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77 Nov 03 17:03:08 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:09 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-70f1b18c-8437-47ce-a150-6df0172aec77" returned: 0 in 0.601s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Lock "cinder-quobyte-70f1b18c-8437-47ce-a150-6df0172aec77" released by "delete_volume" :: held 1.601s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Created reservations ['ceac32d2-d177-4da3-be27-2776968be02c', 'd5cc9e4c-f655-48fc-8bf2-1e8b15314de0', '9b6bbf26-b601-4e68-ab97-1a7f1febca84', 'ef5f434b-248c-48e9-a01e-a07094e3d203'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:09 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:03:09 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:09 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.354s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:03:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Deleted volume successfully. Nov 03 17:03:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bff6bc1-6a12-452c-8e0c-d68f76f9b930 tempest-ServerRescueNegativeTestJSON-1342060284 None] Lock "cinder-70f1b18c-8437-47ce-a150-6df0172aec77-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:19 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=10,cinder:SELECT=8,cinder:INSERT=3 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:03:19 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-7e5ef2b4-54de-48ff-bad8-f6336ecfcdfc req-3423fabc-162d-4b2b-b895-7898c976d799 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-7e5ef2b4-54de-48ff-bad8-f6336ecfcdfc req-3423fabc-162d-4b2b-b895-7898c976d799 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-7e5ef2b4-54de-48ff-bad8-f6336ecfcdfc req-3423fabc-162d-4b2b-b895-7898c976d799 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-7e5ef2b4-54de-48ff-bad8-f6336ecfcdfc req-3423fabc-162d-4b2b-b895-7898c976d799 tempest-ServerActionsTestOtherA-894703843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-414b9723-ca47-4dd4-812e-8fa54a880e0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '570df73a-58eb-4e55-ab95-d19cc34e964c', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:03:29 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-7e5ef2b4-54de-48ff-bad8-f6336ecfcdfc req-3423fabc-162d-4b2b-b895-7898c976d799 tempest-ServerActionsTestOtherA-894703843 None] attachment_update completed successfully. Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Flow 'volume_create_manager' (ee2806fb-e235-492a-9d93-7ff0a00a4d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c365e549-20e6-40d8-8573-70484c6c3d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c365e549-20e6-40d8-8573-70484c6c3d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-567092740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1d687f-9fd2-405c-9b0e-27771637fea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b138537d3314c5f92f40832da9a4221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:30Z,use_quota=True,user_id='531c1152bef34b11a92cf2875b9bcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d3f9e3-d218-4fbf-b741-1b1fc4c9eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d3f9e3-d218-4fbf-b741-1b1fc4c9eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c050cb-9e6d-4e51-a66c-efcf648ab3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c050cb-9e6d-4e51-a66c-efcf648ab3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f1d687f-9fd2-405c-9b0e-27771637fea5', 'volume_name': 'volume-1f1d687f-9fd2-405c-9b0e-27771637fea5', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccb58f2-08a4-41c5-807f-c73e66ec784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccb58f2-08a4-41c5-807f-c73e66ec784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069098b6-924b-4c1a-9736-8ec198cba290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:29 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Volume 1f1d687f-9fd2-405c-9b0e-27771637fea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f1d687f-9fd2-405c-9b0e-27771637fea5', 'volume_size': 1} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-567092740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1d687f-9fd2-405c-9b0e-27771637fea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b138537d3314c5f92f40832da9a4221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:30Z,use_quota=True,user_id='531c1152bef34b11a92cf2875b9bcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Creating volume 1f1d687f-9fd2-405c-9b0e-27771637fea5 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:03:29 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:29 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5 1073741824 Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:29 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:29 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:03:29 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:30 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.379s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:03:30 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5 1073741824" returned: 0 in 0.649s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:30 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5 Nov 03 17:03:30 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:30 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5" returned: 0 in 0.361s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:03:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069098b6-924b-4c1a-9736-8ec198cba290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f1d687f-9fd2-405c-9b0e-27771637fea5', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c643fad-f331-4586-9a38-57c874e8f135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:30 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Volume volume-1f1d687f-9fd2-405c-9b0e-27771637fea5 (1f1d687f-9fd2-405c-9b0e-27771637fea5): created successfully Nov 03 17:03:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c643fad-f331-4586-9a38-57c874e8f135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Flow 'volume_create_manager' (ee2806fb-e235-492a-9d93-7ff0a00a4d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-79e92200-d4ba-4783-8a26-41275dc61b5e tempest-AttachVolumeTestJSON-777155928 None] Created volume successfully. Nov 03 17:03:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-7d57f3fb-57ea-4373-b039-80dca4376553 req-d8f130af-fa9d-493e-975d-d8db58a137b8 tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-7d57f3fb-57ea-4373-b039-80dca4376553 req-d8f130af-fa9d-493e-975d-d8db58a137b8 tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-7d57f3fb-57ea-4373-b039-80dca4376553 req-d8f130af-fa9d-493e-975d-d8db58a137b8 tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-7d57f3fb-57ea-4373-b039-80dca4376553 req-d8f130af-fa9d-493e-975d-d8db58a137b8 tempest-AttachVolumeTestJSON-777155928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-1f1d687f-9fd2-405c-9b0e-27771637fea5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7c842e8-f1d7-471c-ad3e-87794e0446c7', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:03:32 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-7d57f3fb-57ea-4373-b039-80dca4376553 req-d8f130af-fa9d-493e-975d-d8db58a137b8 tempest-AttachVolumeTestJSON-777155928 None] attachment_update completed successfully. Nov 03 17:03:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-f3d43a22-7bd0-4b85-a874-1ba748aaa18d req-5832d1b7-9d57-495b-b9f6-ddd93e4959b4 tempest-ServerActionsTestOtherA-894703843 None] Terminate volume connection completed successfully. Nov 03 17:03:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-f3d43a22-7bd0-4b85-a874-1ba748aaa18d req-5832d1b7-9d57-495b-b9f6-ddd93e4959b4 tempest-ServerActionsTestOtherA-894703843 None] Deleting attachment 570df73a-58eb-4e55-ab95-d19cc34e964c. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:03:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-f3d43a22-7bd0-4b85-a874-1ba748aaa18d req-7a613511-62a6-46a7-a1ae-a90ce856a2cc tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-f3d43a22-7bd0-4b85-a874-1ba748aaa18d req-7a613511-62a6-46a7-a1ae-a90ce856a2cc tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-f3d43a22-7bd0-4b85-a874-1ba748aaa18d req-7a613511-62a6-46a7-a1ae-a90ce856a2cc tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-f3d43a22-7bd0-4b85-a874-1ba748aaa18d req-7a613511-62a6-46a7-a1ae-a90ce856a2cc tempest-ServerActionsTestOtherA-894703843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-414b9723-ca47-4dd4-812e-8fa54a880e0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64e1a25a-2055-404d-ade4-ba5baea8a4fe', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:03:34 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-f3d43a22-7bd0-4b85-a874-1ba748aaa18d req-7a613511-62a6-46a7-a1ae-a90ce856a2cc tempest-ServerActionsTestOtherA-894703843 None] attachment_update completed successfully. Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Flow 'volume_create_manager' (95ee3513-22be-4617-9f24-bcf20d7554d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c9b891-b0a0-4061-b3c4-72d38d099dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c9b891-b0a0-4061-b3c4-72d38d099dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-316266525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de37669-68e3-4036-8b91-46040ecce171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b138537d3314c5f92f40832da9a4221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:35Z,use_quota=True,user_id='531c1152bef34b11a92cf2875b9bcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1696f9fa-d4f5-4d13-86f8-322a6e9970e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1696f9fa-d4f5-4d13-86f8-322a6e9970e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46c6259-6f2b-491e-9481-6da17496f76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46c6259-6f2b-491e-9481-6da17496f76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de37669-68e3-4036-8b91-46040ecce171', 'volume_name': 'volume-4de37669-68e3-4036-8b91-46040ecce171', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62807bb5-90dc-43a0-afe2-76eeb339b936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62807bb5-90dc-43a0-afe2-76eeb339b936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df2eb39-673d-45cc-99f6-780c6191f255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:35 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Volume 4de37669-68e3-4036-8b91-46040ecce171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de37669-68e3-4036-8b91-46040ecce171', 'volume_size': 1} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-316266525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de37669-68e3-4036-8b91-46040ecce171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b138537d3314c5f92f40832da9a4221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:03:35Z,use_quota=True,user_id='531c1152bef34b11a92cf2875b9bcc61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Creating volume 4de37669-68e3-4036-8b91-46040ecce171 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:03:35 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:03:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:35 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171 1073741824 Nov 03 17:03:35 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:36 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171 1073741824" returned: 0 in 0.686s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:36 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171 Nov 03 17:03:36 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:36 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171" returned: 0 in 0.480s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:03:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df2eb39-673d-45cc-99f6-780c6191f255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de37669-68e3-4036-8b91-46040ecce171', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c20b98-135e-4415-a5b8-f6add96c35c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:03:36 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Volume volume-4de37669-68e3-4036-8b91-46040ecce171 (4de37669-68e3-4036-8b91-46040ecce171): created successfully Nov 03 17:03:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c20b98-135e-4415-a5b8-f6add96c35c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:03:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Flow 'volume_create_manager' (95ee3513-22be-4617-9f24-bcf20d7554d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:03:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-9f7c9110-4d5e-49b2-9f8d-475b32413e2d tempest-AttachVolumeTestJSON-777155928 None] Created volume successfully. Nov 03 17:03:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-260d8360-7ebb-408e-99ee-237ceb2cbee5 req-42088602-9383-417a-a334-813ee0f9e7c9 tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-260d8360-7ebb-408e-99ee-237ceb2cbee5 req-42088602-9383-417a-a334-813ee0f9e7c9 tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-260d8360-7ebb-408e-99ee-237ceb2cbee5 req-42088602-9383-417a-a334-813ee0f9e7c9 tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-260d8360-7ebb-408e-99ee-237ceb2cbee5 req-42088602-9383-417a-a334-813ee0f9e7c9 tempest-AttachVolumeTestJSON-777155928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-4de37669-68e3-4036-8b91-46040ecce171', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e985e05e-f489-4441-b3b2-d1348ddf14ef', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:03:39 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-260d8360-7ebb-408e-99ee-237ceb2cbee5 req-42088602-9383-417a-a334-813ee0f9e7c9 tempest-AttachVolumeTestJSON-777155928 None] attachment_update completed successfully. Nov 03 17:03:43 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-753c35a6-24e7-4d86-b46c-be1ff1491378 req-74c3f909-e937-4a07-85c3-b724b7f876cc tempest-AttachVolumeTestJSON-777155928 None] Terminate volume connection completed successfully. Nov 03 17:03:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-753c35a6-24e7-4d86-b46c-be1ff1491378 req-74c3f909-e937-4a07-85c3-b724b7f876cc tempest-AttachVolumeTestJSON-777155928 None] Deleting attachment f7c842e8-f1d7-471c-ad3e-87794e0446c7. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:03:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Acquiring lock "cinder-952a6a8d-f05c-4842-8484-e59058bba44a-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Lock "cinder-952a6a8d-f05c-4842-8484-e59058bba44a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:45 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-5ac2cf64-2715-448f-8b7e-04762045c1e1 req-f2ddba37-0521-42c7-9a54-1a5031cc8c6f tempest-AttachVolumeTestJSON-777155928 None] Terminate volume connection completed successfully. Nov 03 17:03:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-5ac2cf64-2715-448f-8b7e-04762045c1e1 req-f2ddba37-0521-42c7-9a54-1a5031cc8c6f tempest-AttachVolumeTestJSON-777155928 None] Deleting attachment e985e05e-f489-4441-b3b2-d1348ddf14ef. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:03:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Acquiring lock "cinder-quobyte-952a6a8d-f05c-4842-8484-e59058bba44a" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Lock "cinder-quobyte-952a6a8d-f05c-4842-8484-e59058bba44a" acquired by "delete_volume" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:45 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[381c2433-7bf4-4add-bc01-6e60dff92de6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:45 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a Nov 03 17:03:45 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:46 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a" returned: 0 in 0.793s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:46 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a Nov 03 17:03:46 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:46 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-952a6a8d-f05c-4842-8484-e59058bba44a" returned: 0 in 0.400s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Lock "cinder-quobyte-952a6a8d-f05c-4842-8484-e59058bba44a" released by "delete_volume" :: held 1.325s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:47 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Created reservations ['b376e279-09fa-425b-a809-753b3dbe1162', 'b0a9f3f3-5eb2-48bc-b6a5-1f23719d13d9', '80a452d1-b3d0-446e-b373-09ac6720c2ed', '83697c5c-01d1-4ac6-8b51-a65206b3ef8a'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:47 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:03:47 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:47 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.518s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:47 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:03:47 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Deleted volume successfully. Nov 03 17:03:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a8caa94d-3f6b-4568-820b-55c5072204c2 tempest-AttachVolumeShelveTestJSON-649961911 None] Lock "cinder-952a6a8d-f05c-4842-8484-e59058bba44a-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "cinder-4de37669-68e3-4036-8b91-46040ecce171-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-4de37669-68e3-4036-8b91-46040ecce171-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "cinder-quobyte-4de37669-68e3-4036-8b91-46040ecce171" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-quobyte-4de37669-68e3-4036-8b91-46040ecce171" acquired by "delete_volume" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:53 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2231f4b9-efa2-4801-8216-ff32fed3c8d1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:54 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171 Nov 03 17:03:54 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:54 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171" returned: 0 in 0.638s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:54 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171 Nov 03 17:03:54 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:55 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4de37669-68e3-4036-8b91-46040ecce171" returned: 0 in 0.473s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-quobyte-4de37669-68e3-4036-8b91-46040ecce171" released by "delete_volume" :: held 1.190s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Created reservations ['f8f103ea-edd9-4ba3-a895-0232d4131e00', '454eb284-6e5d-4326-926e-acf41c2ff2cb', '113d7528-dc2c-46a8-be6e-f5ef166af460', '9154fdfd-9982-4655-9702-8a0a7f0da79c'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:55 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:03:55 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:55 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.486s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:03:55 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Deleted volume successfully. Nov 03 17:03:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f2ea5322-97a4-4a64-9ecc-8a5743ef9fce tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-4de37669-68e3-4036-8b91-46040ecce171-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "cinder-1f1d687f-9fd2-405c-9b0e-27771637fea5-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-1f1d687f-9fd2-405c-9b0e-27771637fea5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "cinder-quobyte-1f1d687f-9fd2-405c-9b0e-27771637fea5" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-quobyte-1f1d687f-9fd2-405c-9b0e-27771637fea5" acquired by "delete_volume" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:56 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd28aba8-5ef2-4b5c-8605-4d9ba9bd8c1d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:56 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5 Nov 03 17:03:56 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:56 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5" returned: 0 in 0.515s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:56 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5 Nov 03 17:03:56 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:57 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f1d687f-9fd2-405c-9b0e-27771637fea5" returned: 0 in 0.322s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-quobyte-1f1d687f-9fd2-405c-9b0e-27771637fea5" released by "delete_volume" :: held 0.905s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Created reservations ['8e79dfc5-d0e5-47b9-bb90-c4617b6e0dc7', '6403369d-1a98-417a-920f-4da3b83767bb', '74cf0458-b441-4e77-8aa7-c3f6555d452a', '02fca50b-62dc-4a85-ba23-83fb299af043'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:57 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:03:57 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:57 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.313s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:03:57 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Deleted volume successfully. Nov 03 17:03:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-561c9821-17d4-428a-9262-49ffda6a83df tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-1f1d687f-9fd2-405c-9b0e-27771637fea5-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:03:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "cinder-a9606fde-83f9-4fa0-872a-b020df6af714-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-a9606fde-83f9-4fa0-872a-b020df6af714-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "cinder-quobyte-a9606fde-83f9-4fa0-872a-b020df6af714" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:03:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-quobyte-a9606fde-83f9-4fa0-872a-b020df6af714" acquired by "delete_volume" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:03:58 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[546eb848-2a92-4560-bede-d84545d6b7e7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:03:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:59 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714 Nov 03 17:03:59 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:59 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714" returned: 0 in 0.526s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:03:59 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714 Nov 03 17:03:59 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:03:59 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Nov 03 17:03:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a9606fde-83f9-4fa0-872a-b020df6af714" returned: 0 in 0.459s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:03:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-quobyte-a9606fde-83f9-4fa0-872a-b020df6af714" released by "delete_volume" :: held 1.054s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:00 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Created reservations ['d1677a8c-9f3b-419c-8a81-fdcb361abebb', '23edc465-338c-48c4-8c0f-6cf734d5ed3a', 'ccb55bdf-d837-4f85-88b5-8e23684339a8', '3f5e415a-4bfd-4ec7-8902-a5add413c8a7'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:00 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:04:00 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:00 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.783s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:01 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:01 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Deleted volume successfully. Nov 03 17:04:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ebb7bf3b-09cb-4cf8-8a8b-8b47e338eb67 tempest-AttachVolumeTestJSON-777155928 None] Lock "cinder-a9606fde-83f9-4fa0-872a-b020df6af714-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6601af9a-73ec-446a-a0be-fa835f04f1cc tempest-GroupSnapshotsTest-625850232 None] Group tempest-GroupSnapshotsTest-Group-976608864: creating Nov 03 17:04:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6601af9a-73ec-446a-a0be-fa835f04f1cc tempest-GroupSnapshotsTest-625850232 None] Group tempest-GroupSnapshotsTest-Group-976608864: created successfully Nov 03 17:04:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6601af9a-73ec-446a-a0be-fa835f04f1cc tempest-GroupSnapshotsTest-625850232 None] Create group completed successfully. Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Flow 'volume_create_manager' (18dc424d-c127-4025-bc25-aa5afc3eb014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150099e5-5d46-457a-8011-f00afc3585fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150099e5-5d46-457a-8011-f00afc3585fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-745067097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93386806-4451-48f5-bd9b-97f949db1fe6,host='devstack@QuobyteHD#QuobyteHD',id=857b8be7-65aa-4abf-8885-9335d91516e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cb58bdd5c949908fba3f3ec61a8346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:07Z,use_quota=True,user_id='09f500add56244d08b60c361b0b7c8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2d005b9-f0bd-4b4e-b55c-fda29ba72be1),volume_type_id=b2d005b9-f0bd-4b4e-b55c-fda29ba72be1)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b668dffd-42aa-4791-ace3-a9a1a65cff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b668dffd-42aa-4791-ace3-a9a1a65cff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abd6ee2-f625-4f97-b95d-aa155d7ceeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abd6ee2-f625-4f97-b95d-aa155d7ceeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857b8be7-65aa-4abf-8885-9335d91516e1', 'volume_name': 'volume-857b8be7-65aa-4abf-8885-9335d91516e1', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e3f499-b7c9-4899-9604-3c9d85414751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e3f499-b7c9-4899-9604-3c9d85414751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66f5dc9-d532-4966-b8c3-7926be27b305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:07 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Volume 857b8be7-65aa-4abf-8885-9335d91516e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857b8be7-65aa-4abf-8885-9335d91516e1', 'volume_size': 1} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=93386806-4451-48f5-bd9b-97f949db1fe6,created_at=2026-11-03T16:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-745067097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93386806-4451-48f5-bd9b-97f949db1fe6,host='devstack@QuobyteHD#QuobyteHD',id=857b8be7-65aa-4abf-8885-9335d91516e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cb58bdd5c949908fba3f3ec61a8346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:07Z,use_quota=True,user_id='09f500add56244d08b60c361b0b7c8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2d005b9-f0bd-4b4e-b55c-fda29ba72be1),volume_type_id=b2d005b9-f0bd-4b4e-b55c-fda29ba72be1)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Creating volume 857b8be7-65aa-4abf-8885-9335d91516e1 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:07 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:04:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:07 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 1073741824 Nov 03 17:04:07 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:08 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-1febeda7-c45e-4d83-9e7a-eb2f252135b7 req-35e8f202-a790-433c-82c2-4bc94d77f6c4 tempest-ServerActionsTestOtherA-894703843 None] Terminate volume connection completed successfully. Nov 03 17:04:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-1febeda7-c45e-4d83-9e7a-eb2f252135b7 req-35e8f202-a790-433c-82c2-4bc94d77f6c4 tempest-ServerActionsTestOtherA-894703843 None] Deleting attachment 64e1a25a-2055-404d-ade4-ba5baea8a4fe. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:04:08 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 1073741824" returned: 0 in 0.892s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:08 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 Nov 03 17:04:08 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:08 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1" returned: 0 in 0.303s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:04:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66f5dc9-d532-4966-b8c3-7926be27b305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857b8be7-65aa-4abf-8885-9335d91516e1', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77b05e1-f0ff-4fd1-99b1-a077e89bc773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:08 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Volume volume-857b8be7-65aa-4abf-8885-9335d91516e1 (857b8be7-65aa-4abf-8885-9335d91516e1): created successfully Nov 03 17:04:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77b05e1-f0ff-4fd1-99b1-a077e89bc773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Flow 'volume_create_manager' (18dc424d-c127-4025-bc25-aa5afc3eb014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:08 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-da5d3ae4-b05a-49fa-ad5d-91169df59bd0 tempest-GroupSnapshotsTest-625850232 None] Created volume successfully. Nov 03 17:04:10 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] GroupSnapshot 8fbade2a-fcc8-46c7-a646-f419d404f3ee: creating. Nov 03 17:04:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] Group snapshot 8fbade2a-fcc8-46c7-a646-f419d404f3ee: creating. {{(pid=86661) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:04:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] Creating offline snapshot af84cf77-23ee-4b38-a9ef-dbbd16fc7012 of volume 857b8be7-65aa-4abf-8885-9335d91516e1 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:04:10 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c8b72e-78d1-4920-94cd-f63bb158d4e4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:10 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 Nov 03 17:04:10 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:10 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1" returned: 0 in 0.425s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:10 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 1G Nov 03 17:04:10 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:11 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 1G" returned: 0 in 0.637s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857b8be7-65aa-4abf-8885-9335d91516e1 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:11 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857b8be7-65aa-4abf-8885-9335d91516e1 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 Nov 03 17:04:11 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:11 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857b8be7-65aa-4abf-8885-9335d91516e1 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012" returned: 0 in 0.470s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:11 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:04:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:11 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 Nov 03 17:04:11 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:12 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Flow 'volume_create_manager' (5f878048-aee1-4dc0-8d1f-efa386e00684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c362fdc-ecbf-42e4-8b12-dff8294fb33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012" returned: 0 in 0.319s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c362fdc-ecbf-42e4-8b12-dff8294fb33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1477019374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd249e1-67a8-4548-950c-f397bdff0f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbcb80ab698406aa97c28a32fbc79a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:12Z,use_quota=True,user_id='861517d95f7a4abaad14cd7ade69246b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d846b5-02c2-44b7-acb5-c3bedd564224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d846b5-02c2-44b7-acb5-c3bedd564224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3035371d-e8c4-4186-9b74-a9758a0a8800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3035371d-e8c4-4186-9b74-a9758a0a8800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd249e1-67a8-4548-950c-f397bdff0f27', 'volume_name': 'volume-9fd249e1-67a8-4548-950c-f397bdff0f27', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e796d4b-2610-4d7b-91ef-5dd90c970743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e796d4b-2610-4d7b-91ef-5dd90c970743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b432c9-7d33-40cb-985a-daa23c9d5b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:12 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Volume 9fd249e1-67a8-4548-950c-f397bdff0f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd249e1-67a8-4548-950c-f397bdff0f27', 'volume_size': 1} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:12 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.info Nov 03 17:04:12 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:12 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.info" returned: 0 in 0.307s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:12 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:12 devstack sudo[91849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.info Nov 03 17:04:12 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:12 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.info" returned: 0 in 0.297s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1477019374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd249e1-67a8-4548-950c-f397bdff0f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbcb80ab698406aa97c28a32fbc79a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:12Z,use_quota=True,user_id='861517d95f7a4abaad14cd7ade69246b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Creating volume 9fd249e1-67a8-4548-950c-f397bdff0f27 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:13 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:13 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27 1073741824 Nov 03 17:04:13 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:13 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-57222790-94cb-4460-a219-22047793de28 tempest-GroupSnapshotsTest-625850232 None] group_snapshot 8fbade2a-fcc8-46c7-a646-f419d404f3ee: created successfully Nov 03 17:04:13 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27 1073741824" returned: 0 in 0.627s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:13 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27 Nov 03 17:04:13 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:14 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27" returned: 0 in 0.328s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:04:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b432c9-7d33-40cb-985a-daa23c9d5b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd249e1-67a8-4548-950c-f397bdff0f27', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d141696-89bb-4290-bfe3-5347e6581ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:14 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Volume volume-9fd249e1-67a8-4548-950c-f397bdff0f27 (9fd249e1-67a8-4548-950c-f397bdff0f27): created successfully Nov 03 17:04:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d141696-89bb-4290-bfe3-5347e6581ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Flow 'volume_create_manager' (5f878048-aee1-4dc0-8d1f-efa386e00684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:14 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-4d84a613-a27b-4522-aef8-8a1f7d6cc1db tempest-ServersNegativeTestJSON-184387344 None] Created volume successfully. Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-af84cf77-23ee-4b38-a9ef-dbbd16fc7012-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" by "_create_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-af84cf77-23ee-4b38-a9ef-dbbd16fc7012-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Creating volume 0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 from snapshot af84cf77-23ee-4b38-a9ef-dbbd16fc7012 {{(pid=86661) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] snapshot: af84cf77-23ee-4b38-a9ef-dbbd16fc7012, volume: 0406d508-b0dc-4f27-b4c4-7c4d17cf73f7, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd090df-333d-4985-9b72-1d0b12d86e20]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:15 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 Nov 03 17:04:15 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:16 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012" returned: 0 in 0.608s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-857b8be7-65aa-4abf-8885-9335d91516e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2214e2b5-bd84-4d57-a669-59b7071fc3c3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Flow 'volume_create_manager' (4b5611bf-66e6-421f-b889-d9a48ebc4291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd49596-c4f5-421d-ba1a-abba32b8eb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd49596-c4f5-421d-ba1a-abba32b8eb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-458860704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4974fd90-6739-4629-ba01-378dd8f2abf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd93120db6e64032855ff3fbdeab0994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:16Z,use_quota=True,user_id='c5e8e041c45f4a819fc7ccc20aa2ce22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac4232e-6608-4769-a7c5-3350820bad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac4232e-6608-4769-a7c5-3350820bad6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1959e20c-1bdc-41c0-a9dd-bdb9d2935cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.image.glance [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Creating Keystone auth plugin from conf {{(pid=86661) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:04:16 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 Nov 03 17:04:16 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:16 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1" returned: 0 in 0.531s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:16 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 Nov 03 17:04:16 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Flow 'volume_create_manager' (6c10d44c-1965-4ffc-a2c4-3ca1a953e5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35a9280-525b-4896-992d-ab1f71aa2e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35a9280-525b-4896-992d-ab1f71aa2e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1852616801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7fc55ea-23e0-4ac4-aed3-21be1affc3fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff3aead290824d0fb9a24c7bff844795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:17Z,use_quota=True,user_id='512997e0ba02444288d9523a0bd1a7b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e813d91-de1b-4477-adae-b953a579bf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e813d91-de1b-4477-adae-b953a579bf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f802420-9789-4ae0-9741-36f7311e5b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f802420-9789-4ae0-9741-36f7311e5b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7fc55ea-23e0-4ac4-aed3-21be1affc3fc', 'volume_name': 'volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a954aa34-edac-4742-a3dd-f6ab68edcff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a954aa34-edac-4742-a3dd-f6ab68edcff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8102e70d-6698-406c-825f-9171a1f67fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Volume c7fc55ea-23e0-4ac4-aed3-21be1affc3fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc', 'volume_size': 1} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1959e20c-1bdc-41c0-a9dd-bdb9d2935cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4974fd90-6739-4629-ba01-378dd8f2abf1', 'volume_name': 'volume-4974fd90-6739-4629-ba01-378dd8f2abf1', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba00dd5-f8f9-4f31-a03f-6ac193215691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba00dd5-f8f9-4f31-a03f-6ac193215691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd8fd5c-be46-4f8a-8ace-bee1d096a432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Volume 4974fd90-6739-4629-ba01-378dd8f2abf1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4974fd90-6739-4629-ba01-378dd8f2abf1', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Trying to clone 4974fd90-6739-4629-ba01-378dd8f2abf1 from image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]). {{(pid=86661) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Flow 'volume_create_manager' (cd8ac773-9b63-4bcc-99f2-955561d69219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42eaf71f-78d4-4a5a-a479-998b196a61be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42eaf71f-78d4-4a5a-a479-998b196a61be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-291457711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73e546f-d792-4809-8b15-38c2bd8b14e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbcb80ab698406aa97c28a32fbc79a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:17Z,use_quota=True,user_id='861517d95f7a4abaad14cd7ade69246b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215a7367-df89-46d5-a85c-d13868d04215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215a7367-df89-46d5-a85c-d13868d04215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961bda36-864e-48b8-b930-31565700a7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961bda36-864e-48b8-b930-31565700a7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73e546f-d792-4809-8b15-38c2bd8b14e2', 'volume_name': 'volume-d73e546f-d792-4809-8b15-38c2bd8b14e2', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3780244-a3e3-491f-abb7-b982ad4fc9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3780244-a3e3-491f-abb7-b982ad4fc9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b57614d-cfda-4467-8c65-48c3c0945ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:17 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Volume d73e546f-d792-4809-8b15-38c2bd8b14e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73e546f-d792-4809-8b15-38c2bd8b14e2', 'volume_size': 1} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:04:17 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f20b0f1-65fa-47d1-a228-2e4707e40f3c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:18 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD Nov 03 17:04:18 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:18 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD" returned: 0 in 0.545s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:18 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Temporary image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 is fetched for user c5e8e041c45f4a819fc7ccc20aa2ce22. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:04:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b99137d-1634-4158-9606-37ba2b6d8357]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:18 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD Nov 03 17:04:18 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:19 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD" returned: 0 in 0.521s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:23 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" returned: 0 in 6.389s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:04:23 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Converted 1024.00 MB image at 160.25 MB/s Nov 03 17:04:23 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:23 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 Nov 03 17:04:23 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:23 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" returned: 0 in 0.261s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" released by "_copy_volume_from_snapshot" :: held 7.941s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=83,cinder:UPDATE=48,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-af84cf77-23ee-4b38-a9ef-dbbd16fc7012-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" released by "_create_volume_from_snapshot" :: held 8.037s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.062s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.418s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1852616801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7fc55ea-23e0-4ac4-aed3-21be1affc3fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ff3aead290824d0fb9a24c7bff844795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:17Z,use_quota=True,user_id='512997e0ba02444288d9523a0bd1a7b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Creating volume c7fc55ea-23e0-4ac4-aed3-21be1affc3fc {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:23 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:23 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc 1073741824 Nov 03 17:04:23 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:23 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-baf051da-05d3-43f3-8136-0ca20df99ca8 tempest-GroupSnapshotsTest-625850232 None] Create group from source-snapshot-8fbade2a-fcc8-46c7-a646-f419d404f3ee completed successfully. Nov 03 17:04:23 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc 1073741824" returned: 0 in 0.420s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:23 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc Nov 03 17:04:23 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:24 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc" returned: 0 in 0.246s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.446s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-291457711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73e546f-d792-4809-8b15-38c2bd8b14e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbcb80ab698406aa97c28a32fbc79a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:17Z,use_quota=True,user_id='861517d95f7a4abaad14cd7ade69246b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Creating volume d73e546f-d792-4809-8b15-38c2bd8b14e2 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:24 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8102e70d-6698-406c-825f-9171a1f67fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593a0597-57eb-4781-a8f0-8b198ca56b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:24 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2 1073741824 Nov 03 17:04:24 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:24 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Volume volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc (c7fc55ea-23e0-4ac4-aed3-21be1affc3fc): created successfully Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (593a0597-57eb-4781-a8f0-8b198ca56b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Flow 'volume_create_manager' (6c10d44c-1965-4ffc-a2c4-3ca1a953e5b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-4ce81dad-a4a4-4088-bb11-3515e6218ca3 req-5b51bea2-73ed-448c-95bf-d6b9802735be tempest-VolumesGetTestJSON-2095205673 None] Created volume successfully. Nov 03 17:04:24 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2 1073741824" returned: 0 in 0.453s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:24 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2 Nov 03 17:04:24 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:24 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2" returned: 0 in 0.283s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.792s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-458860704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4974fd90-6739-4629-ba01-378dd8f2abf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd93120db6e64032855ff3fbdeab0994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:16Z,use_quota=True,user_id='c5e8e041c45f4a819fc7ccc20aa2ce22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Creating volume 4974fd90-6739-4629-ba01-378dd8f2abf1 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:24 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:04:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Acquiring lock "cinder-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:25 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 1073741824 Nov 03 17:04:25 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b57614d-cfda-4467-8c65-48c3c0945ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73e546f-d792-4809-8b15-38c2bd8b14e2', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531f9e42-8a64-414f-9590-883d232bf0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Lock "cinder-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:25 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Volume volume-d73e546f-d792-4809-8b15-38c2bd8b14e2 (d73e546f-d792-4809-8b15-38c2bd8b14e2): created successfully Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531f9e42-8a64-414f-9590-883d232bf0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Flow 'volume_create_manager' (cd8ac773-9b63-4bcc-99f2-955561d69219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" acquired by "delete_volume" :: waited 0.039s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-67811694-1829-4c71-9253-e31b9a08ab64 tempest-ServersNegativeTestJSON-184387344 None] Created volume successfully. Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdece7d-7aa2-4b1d-a6ee-d7a5bbaa8b0e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Acquiring lock "cinder-quobyte-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Lock "cinder-quobyte-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba44b9b-4cd0-42e0-bc9d-62361e2143e5]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:25 devstack sudo[91966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 Nov 03 17:04:25 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:25 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc Nov 03 17:04:25 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:25 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 1073741824" returned: 0 in 0.563s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:25 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 Nov 03 17:04:25 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:25 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" returned: 0 in 0.511s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:25 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7 Nov 03 17:04:25 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:25 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc" returned: 0 in 0.451s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Acquiring lock "cinder-d73e546f-d792-4809-8b15-38c2bd8b14e2-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:25 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc Nov 03 17:04:25 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Lock "cinder-d73e546f-d792-4809-8b15-38c2bd8b14e2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Acquiring lock "cinder-quobyte-d73e546f-d792-4809-8b15-38c2bd8b14e2" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Lock "cinder-quobyte-d73e546f-d792-4809-8b15-38c2bd8b14e2" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e123ea-8657-44ff-955e-f8d35e6f93e1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:25 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1" returned: 0 in 0.359s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:04:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Attempting download of 4d6008ab-d7f4-4403-8d44-c7c2165d2356 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}])) to volume 4974fd90-6739-4629-ba01-378dd8f2abf1. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:04:26 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" returned: 0 in 0.344s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2 Nov 03 17:04:26 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec818a9-7ad7-473c-9807-694859ebd34b]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_o5aes5us {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-0406d508-b0dc-4f27-b4c4-7c4d17cf73f7" released by "delete_volume" :: held 0.933s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:26 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc" returned: 0 in 0.347s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Lock "cinder-quobyte-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc" released by "delete_volume" :: held 0.863s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:26 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_o5aes5us Nov 03 17:04:26 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Created reservations ['b853575b-df20-4db0-88a0-282c73765546'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.quota [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Created reservations ['b3ba2758-185e-4932-9194-e9b285b75733', 'e1eba849-2bf6-4b49-b8de-d067e290ac8e', 'b872167c-fb5c-4557-8fc3-c8d6d4073a6a', '481ca526-6fdb-4f58-95b2-ef643f1269ee'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:26 devstack cinder-volume[86661]: WARNING cinder.quota [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-982710613 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-982710613, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:26 devstack cinder-volume[86661]: WARNING cinder.quota [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-982710613 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-982710613, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Created reservations ['aa17df0b-67a2-43e2-879d-7494a8cf7595', 'aec7f4f7-ae57-4067-89ca-c104200736f8', '14def2c2-f845-49c9-b88a-a6a7421cdad1', '7bbba1f2-185a-4ada-9eff-1360f06a9665'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:26 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:04:26 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:26 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2" returned: 0 in 0.535s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:26 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_o5aes5us" returned: 0 in 0.414s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_o5aes5us {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:26 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2 Nov 03 17:04:26 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:26 devstack sudo[92002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:04:26 devstack sudo[92002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:26 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_o5aes5us Nov 03 17:04:26 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:26 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.305s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.manager [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:26 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Deleted volume successfully. Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-77d8c796-4dbd-40e9-9ca4-80378eb544c6 req-ad6e208c-e7d1-407a-a83f-6840bab39d6b tempest-VolumesGetTestJSON-2095205673 None] Lock "cinder-c7fc55ea-23e0-4ac4-aed3-21be1affc3fc-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:26 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d73e546f-d792-4809-8b15-38c2bd8b14e2" returned: 0 in 0.279s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Lock "cinder-quobyte-d73e546f-d792-4809-8b15-38c2bd8b14e2" released by "delete_volume" :: held 0.871s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:26 devstack sudo[92002]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.273s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:26 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2f19460a-f5b7-4a3a-8cc6-79bd3911add7 tempest-GroupSnapshotsTest-625850232 None] Delete group completed successfully. Nov 03 17:04:26 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Created reservations ['cb62e48f-545b-4fbd-9010-64b8fd72c1a5', '70b0d47a-77c4-4a42-9659-f4c6249507ef', '07c30725-aba4-4de1-806f-3bd7bb72afa0', 'da8426dd-8d57-4391-83d2-7592e33bece2'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_o5aes5us" returned: 1 in 0.374s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_o5aes5us' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62a6f2-df04-4e3f-9126-9a45831157c8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:27 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:04:27 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD Nov 03 17:04:27 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:27 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:27 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.232s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Deleted volume successfully. Nov 03 17:04:27 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] 4d6008ab-d7f4-4403-8d44-c7c2165d2356 was qcow2, converting to qcow2 {{(pid=86661) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:27 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 Nov 03 17:04:27 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a5dd26c5-4f87-40d6-8477-7b3dc1d55f68 tempest-ServersNegativeTestJSON-184387344 None] Lock "cinder-d73e546f-d792-4809-8b15-38c2bd8b14e2-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] group_snapshot 8fbade2a-fcc8-46c7-a646-f419d404f3ee: deleting Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] group_snapshot 8fbade2a-fcc8-46c7-a646-f419d404f3ee: deleting {{(pid=86661) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-857b8be7-65aa-4abf-8885-9335d91516e1" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-857b8be7-65aa-4abf-8885-9335d91516e1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-af84cf77-23ee-4b38-a9ef-dbbd16fc7012" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-af84cf77-23ee-4b38-a9ef-dbbd16fc7012" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Deleting offline snapshot af84cf77-23ee-4b38-a9ef-dbbd16fc7012 of volume 857b8be7-65aa-4abf-8885-9335d91516e1 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] snapshot_file for this snap is: volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[baed88e3-1a22-40d4-9af6-2a909a76c0ed]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:27 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 Nov 03 17:04:27 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Acquiring lock "cinder-9fd249e1-67a8-4548-950c-f397bdff0f27-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Lock "cinder-9fd249e1-67a8-4548-950c-f397bdff0f27-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Acquiring lock "cinder-quobyte-9fd249e1-67a8-4548-950c-f397bdff0f27" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Lock "cinder-quobyte-9fd249e1-67a8-4548-950c-f397bdff0f27" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a25ff6c-f970-4c77-8b61-9720ffa95651]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:28 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012" returned: 0 in 0.487s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-857b8be7-65aa-4abf-8885-9335d91516e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bad77e-3251-46c1-bfdf-d0cabfd734cc]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:28 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27 Nov 03 17:04:28 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:28 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 Nov 03 17:04:28 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:28 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27" returned: 0 in 0.459s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:28 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27 Nov 03 17:04:28 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:28 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1" returned: 0 in 0.704s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:29 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 Nov 03 17:04:29 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:29 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-9fd249e1-67a8-4548-950c-f397bdff0f27" returned: 0 in 0.361s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Lock "cinder-quobyte-9fd249e1-67a8-4548-950c-f397bdff0f27" released by "delete_volume" :: held 0.883s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Created reservations ['06ba0f24-aead-48ce-b25e-b0a83b691273', 'c90daeb4-619b-4486-9a70-05fb05516079', 'a303b43d-9092-4430-81f0-7000c2fb2b97', 'f237db6d-72c9-4a0e-ba3e-54439f622b76'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:29 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:04:29 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:29 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012" returned: 0 in 0.502s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:29 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012 Nov 03 17:04:29 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:29 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.389s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:29 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Deleted volume successfully. Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=91,cinder:UPDATE=103,cinder:DELETE=9,cinder:INSERT=20 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-59d03524-9c42-4454-a141-b5065033cf1d tempest-ServersNegativeTestJSON-184387344 None] Lock "cinder-9fd249e1-67a8-4548-950c-f397bdff0f27-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:29 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:04:29 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:29 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1" returned: 0 in 2.770s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:29 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_e2hekxx2devstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:04:29 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Converted 112.00 MB image at 40.41 MB/s Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:30 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 1G Nov 03 17:04:30 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:30 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1.af84cf77-23ee-4b38-a9ef-dbbd16fc7012" returned: 0 in 0.638s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-af84cf77-23ee-4b38-a9ef-dbbd16fc7012" released by "_delete_snapshot" :: held 2.493s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-857b8be7-65aa-4abf-8885-9335d91516e1" released by "delete_snapshot" :: held 2.531s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:30 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:30 devstack cinder-volume[86661]: WARNING cinder.quota [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-982710613 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-982710613, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.590s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] Created reservations ['176004cf-30f1-448e-944d-4e52f750cf41', '1104c39b-c20d-45ec-aec9-0588bf43ba07', '820399ce-474b-4b9f-b997-02b7f0ed467b', 'eeb6708e-54f6-423c-93c8-330fe4862f46'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-47d43f50-58f8-4113-a0b8-436252b0cafd tempest-GroupSnapshotsTest-625850232 None] group_snapshot 8fbade2a-fcc8-46c7-a646-f419d404f3ee: deleted successfully Nov 03 17:04:30 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 1G" returned: 0 in 0.583s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Downloaded image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}])) to volume 4974fd90-6739-4629-ba01-378dd8f2abf1 successfully. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Temporary image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 for user c5e8e041c45f4a819fc7ccc20aa2ce22 is deleted. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Marking volume 4974fd90-6739-4629-ba01-378dd8f2abf1 as bootable. {{(pid=86661) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Copying metadata from image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 to 4974fd90-6739-4629-ba01-378dd8f2abf1. {{(pid=86661) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Creating volume glance metadata for volume 4974fd90-6739-4629-ba01-378dd8f2abf1 backed by image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86661) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd8fd5c-be46-4f8a-8ace-bee1d096a432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4974fd90-6739-4629-ba01-378dd8f2abf1', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d18803-ec6f-438c-a19d-f87fe802bd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:30 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Volume volume-4974fd90-6739-4629-ba01-378dd8f2abf1 (4974fd90-6739-4629-ba01-378dd8f2abf1): created successfully Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d18803-ec6f-438c-a19d-f87fe802bd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Flow 'volume_create_manager' (4b5611bf-66e6-421f-b889-d9a48ebc4291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5bf6cfc5-1359-4f79-9f3f-9ab34ae37317 tempest-ServerActionsTestOtherA-894703843 None] Created volume successfully. Nov 03 17:04:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-857b8be7-65aa-4abf-8885-9335d91516e1" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-857b8be7-65aa-4abf-8885-9335d91516e1" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:31 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[49801241-01f1-4f06-8bda-ee3412927d47]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:31 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 Nov 03 17:04:31 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:32 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1" returned: 0 in 0.519s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:32 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1 Nov 03 17:04:32 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:32 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-857b8be7-65aa-4abf-8885-9335d91516e1" returned: 0 in 0.288s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-857b8be7-65aa-4abf-8885-9335d91516e1" released by "delete_volume" :: held 0.927s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Created reservations ['3755584c-96ad-4453-bd42-38af9cbeb0d0'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:32 devstack cinder-volume[86661]: WARNING cinder.db.api [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-982710613'] Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Created reservations ['ad36a1f8-cd4a-4ff8-9929-d05e8497cdec', '37ea03b9-eebb-482d-8d2f-0869bd89ed56', 'b9cd20a7-a885-40bc-8adb-59e13ae33ea4', '039ddda4-09a5-4314-ac6a-8bf5d34e868b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:32 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:04:32 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.391s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:33 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:33 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-497e5cc4-d6c7-4f71-90af-1f99fdec0f8e tempest-GroupSnapshotsTest-625850232 None] Delete group completed successfully. Nov 03 17:04:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1f090314-89e8-41ef-af52-a7cd05d91f6a tempest-GroupSnapshotsTest-625850232 None] Group tempest-GroupSnapshotsTest-Group-946089791: creating Nov 03 17:04:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1f090314-89e8-41ef-af52-a7cd05d91f6a tempest-GroupSnapshotsTest-625850232 None] Group tempest-GroupSnapshotsTest-Group-946089791: created successfully Nov 03 17:04:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1f090314-89e8-41ef-af52-a7cd05d91f6a tempest-GroupSnapshotsTest-625850232 None] Create group completed successfully. Nov 03 17:04:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-47b2ea45-3f22-49ee-a190-fc2abdf28039 req-08c51195-8ea7-4dea-aca6-0672ec0eb490 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-47b2ea45-3f22-49ee-a190-fc2abdf28039 req-08c51195-8ea7-4dea-aca6-0672ec0eb490 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-47b2ea45-3f22-49ee-a190-fc2abdf28039 req-08c51195-8ea7-4dea-aca6-0672ec0eb490 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-47b2ea45-3f22-49ee-a190-fc2abdf28039 req-08c51195-8ea7-4dea-aca6-0672ec0eb490 tempest-ServerActionsTestOtherA-894703843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-4974fd90-6739-4629-ba01-378dd8f2abf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c44e142-906f-4577-adb2-09c976abd14f', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:04:34 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-47b2ea45-3f22-49ee-a190-fc2abdf28039 req-08c51195-8ea7-4dea-aca6-0672ec0eb490 tempest-ServerActionsTestOtherA-894703843 None] attachment_update completed successfully. Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Flow 'volume_create_manager' (5f3384f4-75d0-4c28-b367-5e9511265976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de043d0-5688-44aa-b790-2459dd6dcf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de043d0-5688-44aa-b790-2459dd6dcf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-282022003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=374aa324-5e73-494d-b143-69e80544ad7c,host='devstack@QuobyteHD#QuobyteHD',id=bd9ac437-7c38-413e-8837-a8a2d545df07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cb58bdd5c949908fba3f3ec61a8346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:35Z,use_quota=True,user_id='09f500add56244d08b60c361b0b7c8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c58ed7be-1fca-48be-8a6b-593d93009cab),volume_type_id=c58ed7be-1fca-48be-8a6b-593d93009cab)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2639ecd-5235-4a64-b41c-f9d436e1dcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2639ecd-5235-4a64-b41c-f9d436e1dcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce71a473-78b4-4c6a-9018-02c343829b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce71a473-78b4-4c6a-9018-02c343829b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9ac437-7c38-413e-8837-a8a2d545df07', 'volume_name': 'volume-bd9ac437-7c38-413e-8837-a8a2d545df07', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ace9942-fdb3-4218-a091-16cd4bf45902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ace9942-fdb3-4218-a091-16cd4bf45902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d7d4b7-2779-44d7-8416-c5f87d59cf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:35 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Volume bd9ac437-7c38-413e-8837-a8a2d545df07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9ac437-7c38-413e-8837-a8a2d545df07', 'volume_size': 1} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=374aa324-5e73-494d-b143-69e80544ad7c,created_at=2026-11-03T16:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-282022003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=374aa324-5e73-494d-b143-69e80544ad7c,host='devstack@QuobyteHD#QuobyteHD',id=bd9ac437-7c38-413e-8837-a8a2d545df07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cb58bdd5c949908fba3f3ec61a8346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:35Z,use_quota=True,user_id='09f500add56244d08b60c361b0b7c8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c58ed7be-1fca-48be-8a6b-593d93009cab),volume_type_id=c58ed7be-1fca-48be-8a6b-593d93009cab)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Creating volume bd9ac437-7c38-413e-8837-a8a2d545df07 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:35 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:04:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:35 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 1073741824 Nov 03 17:04:35 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:36 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 1073741824" returned: 0 in 0.628s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:36 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 Nov 03 17:04:36 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:36 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07" returned: 0 in 0.326s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:04:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d7d4b7-2779-44d7-8416-c5f87d59cf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9ac437-7c38-413e-8837-a8a2d545df07', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6ee0a5-474d-4432-b6e1-d2399a7fc18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:36 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Volume volume-bd9ac437-7c38-413e-8837-a8a2d545df07 (bd9ac437-7c38-413e-8837-a8a2d545df07): created successfully Nov 03 17:04:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6ee0a5-474d-4432-b6e1-d2399a7fc18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Flow 'volume_create_manager' (5f3384f4-75d0-4c28-b367-5e9511265976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f122b571-2c02-4de7-8882-79d8118acab9 tempest-GroupSnapshotsTest-625850232 None] Created volume successfully. Nov 03 17:04:38 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:04:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Flow 'volume_create_manager' (e565493a-b1b7-4ada-a141-366fe89a4149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c7fef0-ae51-4c8e-b72c-4c96d1ee7808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c7fef0-ae51-4c8e-b72c-4c96d1ee7808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1233160846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=374aa324-5e73-494d-b143-69e80544ad7c,host='devstack@QuobyteHD#QuobyteHD',id=037bf640-356a-488d-bccb-1aeb1ef44267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cb58bdd5c949908fba3f3ec61a8346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:39Z,use_quota=True,user_id='09f500add56244d08b60c361b0b7c8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c58ed7be-1fca-48be-8a6b-593d93009cab),volume_type_id=c58ed7be-1fca-48be-8a6b-593d93009cab)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04168e2-7501-4360-9e3c-a7fe4073b7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04168e2-7501-4360-9e3c-a7fe4073b7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd116b8a-251f-4673-b634-b0e772668ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd116b8a-251f-4673-b634-b0e772668ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037bf640-356a-488d-bccb-1aeb1ef44267', 'volume_name': 'volume-037bf640-356a-488d-bccb-1aeb1ef44267', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb04c87-c18a-4ad5-b011-e16020915043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb04c87-c18a-4ad5-b011-e16020915043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4fee07-0937-4045-9481-986e4bbab55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:39 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Volume 037bf640-356a-488d-bccb-1aeb1ef44267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037bf640-356a-488d-bccb-1aeb1ef44267', 'volume_size': 1} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=374aa324-5e73-494d-b143-69e80544ad7c,created_at=2026-11-03T16:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1233160846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=374aa324-5e73-494d-b143-69e80544ad7c,host='devstack@QuobyteHD#QuobyteHD',id=037bf640-356a-488d-bccb-1aeb1ef44267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cb58bdd5c949908fba3f3ec61a8346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:39Z,use_quota=True,user_id='09f500add56244d08b60c361b0b7c8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c58ed7be-1fca-48be-8a6b-593d93009cab),volume_type_id=c58ed7be-1fca-48be-8a6b-593d93009cab)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Creating volume 037bf640-356a-488d-bccb-1aeb1ef44267 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:39 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:39 devstack sudo[92234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 1073741824 Nov 03 17:04:39 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:39 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e68f2131-b028-43d1-a805-b6b728855923 tempest-GroupSnapshotsV319Test-22746729 None] Group tempest-GroupSnapshotsV319Test-Group-1221922788: creating Nov 03 17:04:39 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e68f2131-b028-43d1-a805-b6b728855923 tempest-GroupSnapshotsV319Test-22746729 None] Group tempest-GroupSnapshotsV319Test-Group-1221922788: created successfully Nov 03 17:04:39 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e68f2131-b028-43d1-a805-b6b728855923 tempest-GroupSnapshotsV319Test-22746729 None] Create group completed successfully. Nov 03 17:04:39 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 1073741824" returned: 0 in 0.795s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:40 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 Nov 03 17:04:40 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:40 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267" returned: 0 in 0.362s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:04:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4fee07-0937-4045-9481-986e4bbab55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037bf640-356a-488d-bccb-1aeb1ef44267', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c13864-e0bc-43e7-9603-d27c3e9bad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:40 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Volume volume-037bf640-356a-488d-bccb-1aeb1ef44267 (037bf640-356a-488d-bccb-1aeb1ef44267): created successfully Nov 03 17:04:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c13864-e0bc-43e7-9603-d27c3e9bad04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Flow 'volume_create_manager' (e565493a-b1b7-4ada-a141-366fe89a4149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:40 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-06323af3-eb85-49f2-a1d5-7bf533c61d31 tempest-GroupSnapshotsTest-625850232 None] Created volume successfully. Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Flow 'volume_create_manager' (379bf509-d340-49dd-b069-c69d212cb976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a711c21-9ab0-48ae-9054-1b6260619aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a711c21-9ab0-48ae-9054-1b6260619aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1614082356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18d26715-70e9-49cc-a384-176864f5d80a,host='devstack@QuobyteHD#QuobyteHD',id=79b655d5-33a2-4dc5-97fa-02a0d30a5e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5608861161e545d1937ecf0a1e519b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:41Z,use_quota=True,user_id='5bf946e9536d4b358a1aa0234409a19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913a7c70-6ba5-43c2-9240-e631b5df8d6d),volume_type_id=913a7c70-6ba5-43c2-9240-e631b5df8d6d)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4237b80-5613-4cac-ba50-4bccbb3c13e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4237b80-5613-4cac-ba50-4bccbb3c13e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4845bd8d-86b1-4702-ba27-37dfb3b73844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4845bd8d-86b1-4702-ba27-37dfb3b73844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b655d5-33a2-4dc5-97fa-02a0d30a5e56', 'volume_name': 'volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6cf72f-3b7f-4c63-ac50-76100f494978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6cf72f-3b7f-4c63-ac50-76100f494978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36402a0d-3364-4b27-9f0d-c25d1568b22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:41 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Volume 79b655d5-33a2-4dc5-97fa-02a0d30a5e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56', 'volume_size': 1} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=18d26715-70e9-49cc-a384-176864f5d80a,created_at=2026-11-03T16:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1614082356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18d26715-70e9-49cc-a384-176864f5d80a,host='devstack@QuobyteHD#QuobyteHD',id=79b655d5-33a2-4dc5-97fa-02a0d30a5e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5608861161e545d1937ecf0a1e519b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:04:41Z,use_quota=True,user_id='5bf946e9536d4b358a1aa0234409a19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913a7c70-6ba5-43c2-9240-e631b5df8d6d),volume_type_id=913a7c70-6ba5-43c2-9240-e631b5df8d6d)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Creating volume 79b655d5-33a2-4dc5-97fa-02a0d30a5e56 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:04:41 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:04:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:41 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 1073741824 Nov 03 17:04:41 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:42 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2b1f6488-8715-4f26-88cc-d4c8686f55ef tempest-GroupSnapshotsTest-625850232 None] Update group completed successfully. Nov 03 17:04:42 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 1073741824" returned: 0 in 0.772s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:42 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 Nov 03 17:04:42 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:42 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56" returned: 0 in 0.359s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:04:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36402a0d-3364-4b27-9f0d-c25d1568b22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4600222d-7654-4738-9ed3-bbe6b125daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:04:42 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Volume volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 (79b655d5-33a2-4dc5-97fa-02a0d30a5e56): created successfully Nov 03 17:04:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4600222d-7654-4738-9ed3-bbe6b125daac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:04:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Flow 'volume_create_manager' (379bf509-d340-49dd-b069-c69d212cb976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:04:42 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-9c3639ff-d13c-4bb6-bf8a-115828dce8f1 tempest-GroupSnapshotsV319Test-22746729 None] Created volume successfully. Nov 03 17:04:43 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-aecccf51-befc-4b04-a389-40ad8e0cdf6b tempest-GroupSnapshotsTest-625850232 None] Update group completed successfully. Nov 03 17:04:44 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] GroupSnapshot 7808ee3b-3568-4410-bd0e-0dea3029932b: creating. Nov 03 17:04:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] Group snapshot 7808ee3b-3568-4410-bd0e-0dea3029932b: creating. {{(pid=86661) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:04:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] Creating offline snapshot 438af935-8b19-45ce-a5e8-74aae49b7efc of volume 79b655d5-33a2-4dc5-97fa-02a0d30a5e56 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:04:44 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbeb8b7-faca-4e72-90c8-96f695cd5ce8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:44 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 Nov 03 17:04:44 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:44 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2dd02ef5-bedf-4de9-b096-8d7a8180ef96 tempest-GroupSnapshotsTest-625850232 None] Update group completed successfully. Nov 03 17:04:45 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56" returned: 0 in 0.739s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:45 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc 1G Nov 03 17:04:45 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:45 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc 1G" returned: 0 in 0.870s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:46 devstack sudo[92628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc Nov 03 17:04:46 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:46 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d67aaf27-00dc-49dd-930c-89a8174a9bb2 tempest-GroupSnapshotsTest-625850232 None] Update group completed successfully. Nov 03 17:04:46 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc" returned: 0 in 0.533s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:46 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:04:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:46 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc Nov 03 17:04:46 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:47 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc" returned: 0 in 0.522s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:47 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.info Nov 03 17:04:47 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:47 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.info" returned: 0 in 0.640s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:47 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:04:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:47 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.info Nov 03 17:04:47 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:48 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.info" returned: 0 in 0.472s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.922s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] GroupSnapshot 785ae0f8-da91-45ff-9d38-ab9a73c51a8c: creating. Nov 03 17:04:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Group snapshot 785ae0f8-da91-45ff-9d38-ab9a73c51a8c: creating. {{(pid=86661) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:04:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Creating offline snapshot 83eb0f6f-8345-42c5-b97a-fc7bb7f4510c of volume bd9ac437-7c38-413e-8837-a8a2d545df07 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:04:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d670255d-87be-40ae-9fe8-25d9715f3aa6 tempest-GroupSnapshotsV319Test-22746729 None] group_snapshot 7808ee3b-3568-4410-bd0e-0dea3029932b: created successfully Nov 03 17:04:48 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05eda50-fd9e-4e62-a972-4144e5ea71e7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:48 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 Nov 03 17:04:48 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:49 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07" returned: 0 in 0.773s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:49 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c 1G Nov 03 17:04:49 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:50 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] group_snapshot 7808ee3b-3568-4410-bd0e-0dea3029932b: deleting Nov 03 17:04:50 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c 1G" returned: 0 in 1.061s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9ac437-7c38-413e-8837-a8a2d545df07 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] group_snapshot 7808ee3b-3568-4410-bd0e-0dea3029932b: deleting {{(pid=86661) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:04:50 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9ac437-7c38-413e-8837-a8a2d545df07 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c Nov 03 17:04:50 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Acquiring lock "cinder-quobyte-79b655d5-33a2-4dc5-97fa-02a0d30a5e56" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Lock "cinder-quobyte-79b655d5-33a2-4dc5-97fa-02a0d30a5e56" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Acquiring lock "cinder-quobyte-438af935-8b19-45ce-a5e8-74aae49b7efc" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Lock "cinder-quobyte-438af935-8b19-45ce-a5e8-74aae49b7efc" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Deleting offline snapshot 438af935-8b19-45ce-a5e8-74aae49b7efc of volume 79b655d5-33a2-4dc5-97fa-02a0d30a5e56 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] snapshot_file for this snap is: volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb582e5d-ee43-4482-b907-f1bae4082d41]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:50 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc Nov 03 17:04:50 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:50 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9ac437-7c38-413e-8837-a8a2d545df07 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c" returned: 0 in 0.658s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:50 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:04:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:51 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c Nov 03 17:04:51 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:51 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c" returned: 0 in 0.452s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:51 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc" returned: 0 in 0.924s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:04:51 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.info Nov 03 17:04:51 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:51 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[be01a37a-dd47-46d1-9081-3241d8901d4b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:51 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 Nov 03 17:04:51 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:51 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.info" returned: 0 in 0.511s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:51 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:04:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:52 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.info Nov 03 17:04:52 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:52 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56" returned: 0 in 0.576s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:52 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc Nov 03 17:04:52 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:52 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.info" returned: 0 in 0.532s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.180s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Creating offline snapshot bb004111-63c8-4574-9ef4-a432db2abb59 of volume 037bf640-356a-488d-bccb-1aeb1ef44267 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:04:52 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fb0fa2-1e47-49c5-84fa-87fba0a5fa39]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:52 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 Nov 03 17:04:52 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:52 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc" returned: 0 in 0.779s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:52 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc Nov 03 17:04:52 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:53 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267" returned: 0 in 0.593s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:53 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 1G Nov 03 17:04:53 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:53 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56.438af935-8b19-45ce-a5e8-74aae49b7efc" returned: 0 in 0.433s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Lock "cinder-quobyte-438af935-8b19-45ce-a5e8-74aae49b7efc" released by "_delete_snapshot" :: held 2.935s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:53 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-efb7b036-c212-45e3-9e6b-2fc514631bac req-a1031d57-511e-4d88-85ff-6283a0196a40 tempest-ServerActionsTestOtherA-894703843 None] Terminate volume connection completed successfully. Nov 03 17:04:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-efb7b036-c212-45e3-9e6b-2fc514631bac req-a1031d57-511e-4d88-85ff-6283a0196a40 tempest-ServerActionsTestOtherA-894703843 None] Deleting attachment 3c44e142-906f-4577-adb2-09c976abd14f. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:04:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Lock "cinder-quobyte-79b655d5-33a2-4dc5-97fa-02a0d30a5e56" released by "delete_snapshot" :: held 2.976s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:53 devstack cinder-volume[86661]: WARNING cinder.quota [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1684679546 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1684679546, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:53 devstack cinder-volume[86661]: WARNING cinder.quota [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1684679546 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1684679546, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:53 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] Created reservations ['e80799bb-9d0e-4b14-9898-2f55a8ec4f18', '331761f8-3e03-46d8-9b82-e98784788855', '65f39c21-f46f-4486-abd9-ba8e36086c2d', 'd2d2f5e1-cc25-4ac6-85c5-efd4b26dac9c'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:53 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3c7865f2-2bfd-4aa4-890e-1f3b42636796 tempest-GroupSnapshotsV319Test-22746729 None] group_snapshot 7808ee3b-3568-4410-bd0e-0dea3029932b: deleted successfully Nov 03 17:04:53 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 1G" returned: 0 in 0.616s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-037bf640-356a-488d-bccb-1aeb1ef44267 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:53 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-037bf640-356a-488d-bccb-1aeb1ef44267 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 Nov 03 17:04:53 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:54 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-037bf640-356a-488d-bccb-1aeb1ef44267 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59" returned: 0 in 0.408s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:54 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:04:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:54 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 Nov 03 17:04:54 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Acquiring lock "cinder-quobyte-79b655d5-33a2-4dc5-97fa-02a0d30a5e56" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Lock "cinder-quobyte-79b655d5-33a2-4dc5-97fa-02a0d30a5e56" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:54 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6060877-06b0-4202-940d-9aba518384ab]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:54 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 Nov 03 17:04:54 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:54 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59" returned: 0 in 0.392s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:54 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.info Nov 03 17:04:54 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:54 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56" returned: 0 in 0.508s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:55 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56 Nov 03 17:04:55 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:55 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.info" returned: 0 in 0.401s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:55 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:55 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.info Nov 03 17:04:55 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:55 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79b655d5-33a2-4dc5-97fa-02a0d30a5e56" returned: 0 in 0.425s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Lock "cinder-quobyte-79b655d5-33a2-4dc5-97fa-02a0d30a5e56" released by "delete_volume" :: held 1.069s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:55 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.info" returned: 0 in 0.357s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.905s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-efb7b036-c212-45e3-9e6b-2fc514631bac req-47cf6ee2-9cc2-4fdd-922a-ac89985dd8a5 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-efb7b036-c212-45e3-9e6b-2fc514631bac req-47cf6ee2-9cc2-4fdd-922a-ac89985dd8a5 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-efb7b036-c212-45e3-9e6b-2fc514631bac req-47cf6ee2-9cc2-4fdd-922a-ac89985dd8a5 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Created reservations ['3858edc2-220f-4c29-815e-55dffca43391'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-efb7b036-c212-45e3-9e6b-2fc514631bac req-47cf6ee2-9cc2-4fdd-922a-ac89985dd8a5 tempest-ServerActionsTestOtherA-894703843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-4974fd90-6739-4629-ba01-378dd8f2abf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0930e93a-0f34-428a-969b-a3f11852a7dd', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:04:55 devstack cinder-volume[86661]: WARNING cinder.quota [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1684679546 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1684679546, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Created reservations ['878b2c33-6db8-4d4c-8259-d678e1b926e2', '0d7d4aab-db9e-4919-b9ae-4ee36ec067c1', '3f2c7cb5-22d0-4c41-9f9d-c4f78273c547', '90d93285-a5b7-4307-b7a2-6bd35d780e11'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:04:55 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-66565ab1-aea9-4909-9bca-527efbd9f676 tempest-GroupSnapshotsTest-625850232 None] group_snapshot 785ae0f8-da91-45ff-9d38-ab9a73c51a8c: created successfully Nov 03 17:04:55 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-efb7b036-c212-45e3-9e6b-2fc514631bac req-47cf6ee2-9cc2-4fdd-922a-ac89985dd8a5 tempest-ServerActionsTestOtherA-894703843 None] attachment_update completed successfully. Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:04:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:55 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:04:55 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:56 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.298s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:56 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:04:56 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3f570938-5604-4516-8652-7e79cf127181 tempest-GroupSnapshotsV319Test-22746729 None] Delete group completed successfully. Nov 03 17:04:56 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] group_snapshot 785ae0f8-da91-45ff-9d38-ab9a73c51a8c: deleting Nov 03 17:04:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] group_snapshot 785ae0f8-da91-45ff-9d38-ab9a73c51a8c: deleting {{(pid=86661) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:04:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-bd9ac437-7c38-413e-8837-a8a2d545df07" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-bd9ac437-7c38-413e-8837-a8a2d545df07" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-83eb0f6f-8345-42c5-b97a-fc7bb7f4510c" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-83eb0f6f-8345-42c5-b97a-fc7bb7f4510c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Deleting offline snapshot 83eb0f6f-8345-42c5-b97a-fc7bb7f4510c of volume bd9ac437-7c38-413e-8837-a8a2d545df07 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:04:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] snapshot_file for this snap is: volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:04:56 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[545b752d-0571-4615-9efa-528f8de16f5f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:56 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c Nov 03 17:04:56 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:57 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c" returned: 0 in 0.708s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9ac437-7c38-413e-8837-a8a2d545df07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:04:57 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a044c3-70b0-4db6-92e8-67d5e3bfaed6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:57 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 Nov 03 17:04:57 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:57 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07" returned: 0 in 0.642s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:57 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c Nov 03 17:04:57 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:58 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c" returned: 0 in 0.603s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:58 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c Nov 03 17:04:58 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:04:59 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Nov 03 17:04:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07.83eb0f6f-8345-42c5-b97a-fc7bb7f4510c" returned: 0 in 0.706s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:04:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-83eb0f6f-8345-42c5-b97a-fc7bb7f4510c" released by "_delete_snapshot" :: held 2.884s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-bd9ac437-7c38-413e-8837-a8a2d545df07" released by "delete_snapshot" :: held 2.931s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:04:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-037bf640-356a-488d-bccb-1aeb1ef44267" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-037bf640-356a-488d-bccb-1aeb1ef44267" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-bb004111-63c8-4574-9ef4-a432db2abb59" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:04:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-bb004111-63c8-4574-9ef4-a432db2abb59" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:04:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Deleting offline snapshot bb004111-63c8-4574-9ef4-a432db2abb59 of volume 037bf640-356a-488d-bccb-1aeb1ef44267 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:04:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] snapshot_file for this snap is: volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:04:59 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d032c5-5e5f-419e-bdf9-b76a3b8f64fb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:04:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:04:59 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 Nov 03 17:04:59 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:00 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59" returned: 0 in 0.833s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-037bf640-356a-488d-bccb-1aeb1ef44267(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:05:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0136497-a048-4438-b7d5-42218b3008f9]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:00 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 Nov 03 17:05:00 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:01 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267" returned: 0 in 0.660s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:01 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 Nov 03 17:05:01 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:01 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59" returned: 0 in 0.670s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:01 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59 Nov 03 17:05:01 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:02 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267.bb004111-63c8-4574-9ef4-a432db2abb59" returned: 0 in 0.427s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-bb004111-63c8-4574-9ef4-a432db2abb59" released by "_delete_snapshot" :: held 2.751s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-037bf640-356a-488d-bccb-1aeb1ef44267" released by "delete_snapshot" :: held 2.803s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:02 devstack cinder-volume[86661]: WARNING cinder.quota [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-859665558 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-859665558, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:02 devstack cinder-volume[86661]: WARNING cinder.quota [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-859665558 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-859665558, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:02 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Created reservations ['10c04e40-09a4-48f7-a1cc-4f7c94db84b9', '227da469-1f3d-416f-9ba8-32bfad297dff', 'abb9dc9c-4c43-4a19-97c5-10e10009a592', '4c196325-6200-4bae-9996-de8b159bb580'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:02 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] Created reservations ['eabe141c-b2fc-42fd-a9e0-ff71ec2cc698', 'ddb33f48-319b-45ea-9a0d-4729bc23ce43', '0a4530b0-3bbf-4bd9-a9ad-a940243a8c96', 'ecc42528-6b15-44ea-97ab-2a7d57d6f9e9'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1037c68c-b2c2-4847-b184-e8678457c56f tempest-GroupSnapshotsTest-625850232 None] group_snapshot 785ae0f8-da91-45ff-9d38-ab9a73c51a8c: deleted successfully Nov 03 17:05:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-037bf640-356a-488d-bccb-1aeb1ef44267" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-037bf640-356a-488d-bccb-1aeb1ef44267" acquired by "delete_volume" :: waited 0.046s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:04 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7be2c9-b699-4ea5-8170-d352f8c74765]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:04 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 Nov 03 17:05:04 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:05 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267" returned: 0 in 1.013s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:05 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267 Nov 03 17:05:05 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:06 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-037bf640-356a-488d-bccb-1aeb1ef44267" returned: 0 in 0.613s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-037bf640-356a-488d-bccb-1aeb1ef44267" released by "delete_volume" :: held 1.838s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-bd9ac437-7c38-413e-8837-a8a2d545df07" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-bd9ac437-7c38-413e-8837-a8a2d545df07" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:06 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b6a88e-8214-4ebf-bd01-2ac29ad37d0b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:06 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 Nov 03 17:05:06 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:06 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07" returned: 0 in 0.575s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:06 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07 Nov 03 17:05:06 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:07 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd9ac437-7c38-413e-8837-a8a2d545df07" returned: 0 in 0.420s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-bd9ac437-7c38-413e-8837-a8a2d545df07" released by "delete_volume" :: held 1.107s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:07 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Created reservations ['2ef57abd-7a0e-41b1-8196-c762dffdafb4'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:07 devstack cinder-volume[86661]: WARNING cinder.quota [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-859665558 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-859665558, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:07 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Created reservations ['fdde0654-836d-4176-a531-c59c16590c6e', '0b98b8dd-eb23-4a59-b9c2-b2763895b45d', 'f5771053-a131-4650-b2d6-ff9d9383aed0', '2cff58c5-353b-432a-8b25-954801ea1fb3'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:07 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Created reservations ['03aac130-b2b0-4840-830d-bd9c5d12d93c', '001fb6d4-3005-41a2-8a75-9b660b3aaff5', 'b4d70e09-9644-42bd-9384-d64d0873ad39', 'e3b411f9-4ec8-4eb4-bd31-8cddeb5b1ea1'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:08 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:05:08 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:08 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.490s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:08 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:08 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-421c2126-759f-40a4-9794-b7b198badb4b tempest-GroupSnapshotsTest-625850232 None] Delete group completed successfully. Nov 03 17:05:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-85223ef2-3f10-4459-8839-6e50079bf900 tempest-GroupSnapshotsTest-625850232 None] Group tempest-GroupSnapshotsTest-Group-1997116417: creating Nov 03 17:05:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-85223ef2-3f10-4459-8839-6e50079bf900 tempest-GroupSnapshotsTest-625850232 None] Group tempest-GroupSnapshotsTest-Group-1997116417: created successfully Nov 03 17:05:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-85223ef2-3f10-4459-8839-6e50079bf900 tempest-GroupSnapshotsTest-625850232 None] Create group completed successfully. Nov 03 17:05:10 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c06ff8aa-7b2a-4bf5-a344-fb9c8b46c183 tempest-GroupsTest-1637030817 None] Group tempest-Group1-519939642: creating Nov 03 17:05:10 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c06ff8aa-7b2a-4bf5-a344-fb9c8b46c183 tempest-GroupsTest-1637030817 None] Group tempest-Group1-519939642: created successfully Nov 03 17:05:10 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c06ff8aa-7b2a-4bf5-a344-fb9c8b46c183 tempest-GroupsTest-1637030817 None] Create group completed successfully. Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Flow 'volume_create_manager' (957bb277-f71d-4c09-b29a-8cf79f115216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8b616c-2cbf-4ece-b2dd-0b3b6445d5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8b616c-2cbf-4ece-b2dd-0b3b6445d5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-788550161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c7be75d-5a9e-47e4-898c-00012b590c30,host='devstack@QuobyteHD#QuobyteHD',id=68afee35-0c3a-4a02-a7a1-732624739e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cb58bdd5c949908fba3f3ec61a8346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:11Z,use_quota=True,user_id='09f500add56244d08b60c361b0b7c8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e78820-2f55-4ccf-bb68-bf674bac35d3),volume_type_id=59e78820-2f55-4ccf-bb68-bf674bac35d3)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787b152e-37f7-4022-9c43-370aa0e33102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787b152e-37f7-4022-9c43-370aa0e33102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5385b757-24f1-48d0-a49f-ece38f0f290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5385b757-24f1-48d0-a49f-ece38f0f290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68afee35-0c3a-4a02-a7a1-732624739e26', 'volume_name': 'volume-68afee35-0c3a-4a02-a7a1-732624739e26', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb93694-a219-486a-a010-b03b6fb72314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb93694-a219-486a-a010-b03b6fb72314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77cd399-9c3b-4a98-b80f-6230afb2d018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:10 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Volume 68afee35-0c3a-4a02-a7a1-732624739e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68afee35-0c3a-4a02-a7a1-732624739e26', 'volume_size': 1} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c7be75d-5a9e-47e4-898c-00012b590c30,created_at=2026-11-03T16:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-788550161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c7be75d-5a9e-47e4-898c-00012b590c30,host='devstack@QuobyteHD#QuobyteHD',id=68afee35-0c3a-4a02-a7a1-732624739e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cb58bdd5c949908fba3f3ec61a8346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:11Z,use_quota=True,user_id='09f500add56244d08b60c361b0b7c8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59e78820-2f55-4ccf-bb68-bf674bac35d3),volume_type_id=59e78820-2f55-4ccf-bb68-bf674bac35d3)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Creating volume 68afee35-0c3a-4a02-a7a1-732624739e26 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:11 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:11 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 1073741824 Nov 03 17:05:11 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:11 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 1073741824" returned: 0 in 0.566s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:11 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 Nov 03 17:05:11 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:11 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-03f80be2-938c-4e08-b328-57c5bd9e9a3a tempest-GroupsTest-1637030817 None] Group tempest-Group2-381155793: creating Nov 03 17:05:11 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-03f80be2-938c-4e08-b328-57c5bd9e9a3a tempest-GroupsTest-1637030817 None] Group tempest-Group2-381155793: created successfully Nov 03 17:05:11 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-03f80be2-938c-4e08-b328-57c5bd9e9a3a tempest-GroupsTest-1637030817 None] Create group completed successfully. Nov 03 17:05:11 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26" returned: 0 in 0.312s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77cd399-9c3b-4a98-b80f-6230afb2d018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68afee35-0c3a-4a02-a7a1-732624739e26', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a806830-1948-4e7c-9af8-8e4a116b32e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:12 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Volume volume-68afee35-0c3a-4a02-a7a1-732624739e26 (68afee35-0c3a-4a02-a7a1-732624739e26): created successfully Nov 03 17:05:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a806830-1948-4e7c-9af8-8e4a116b32e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Flow 'volume_create_manager' (957bb277-f71d-4c09-b29a-8cf79f115216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:12 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3ce866b9-228e-463d-8820-8778283a0d9d tempest-GroupSnapshotsTest-625850232 None] Created volume successfully. Nov 03 17:05:13 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Flow 'volume_create_manager' (92a197ef-d9f7-44b9-a83f-492a9152194c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec2049a-53e1-4f25-ac6f-a96e7b5ab12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:14 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] GroupSnapshot 216ec12b-c22e-4512-8076-b33448f0dcef: creating. Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec2049a-53e1-4f25-ac6f-a96e7b5ab12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-425622886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3fd5d15-a278-4eb4-8b8c-3bb93b2b09ac,host='devstack@QuobyteHD#QuobyteHD',id=f7346afe-0a0c-414d-b4e8-7d831512d069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0098b504ead649178ecf7dd78da32233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:14Z,use_quota=True,user_id='5b3a5a5fb1e2434bbfc81139dfae60cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74fab4a9-16a3-4392-b4f6-cbb385e8ef3e),volume_type_id=74fab4a9-16a3-4392-b4f6-cbb385e8ef3e)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a579ef94-607b-470e-9576-85dbc9a9db9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a579ef94-607b-470e-9576-85dbc9a9db9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc54c2cf-55a1-4111-9ca9-eec4e3cff41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc54c2cf-55a1-4111-9ca9-eec4e3cff41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7346afe-0a0c-414d-b4e8-7d831512d069', 'volume_name': 'volume-f7346afe-0a0c-414d-b4e8-7d831512d069', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e73ee1-2a46-4b89-aca4-0bf496fe6fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e73ee1-2a46-4b89-aca4-0bf496fe6fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de78d5a1-b99a-44e4-9501-ef8979f7cef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:14 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Volume f7346afe-0a0c-414d-b4e8-7d831512d069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7346afe-0a0c-414d-b4e8-7d831512d069', 'volume_size': 1} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3fd5d15-a278-4eb4-8b8c-3bb93b2b09ac,created_at=2026-11-03T16:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-425622886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3fd5d15-a278-4eb4-8b8c-3bb93b2b09ac,host='devstack@QuobyteHD#QuobyteHD',id=f7346afe-0a0c-414d-b4e8-7d831512d069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0098b504ead649178ecf7dd78da32233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:14Z,use_quota=True,user_id='5b3a5a5fb1e2434bbfc81139dfae60cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74fab4a9-16a3-4392-b4f6-cbb385e8ef3e),volume_type_id=74fab4a9-16a3-4392-b4f6-cbb385e8ef3e)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Creating volume f7346afe-0a0c-414d-b4e8-7d831512d069 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:14 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] Group snapshot 216ec12b-c22e-4512-8076-b33448f0dcef: creating. {{(pid=86661) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:14 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069 1073741824 Nov 03 17:05:14 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:14 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069 1073741824" returned: 0 in 0.611s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:14 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069 Nov 03 17:05:14 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:15 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069" returned: 0 in 0.348s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.030s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de78d5a1-b99a-44e4-9501-ef8979f7cef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7346afe-0a0c-414d-b4e8-7d831512d069', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b0c3fd-8373-4d1f-830e-89e852d1c554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] Creating offline snapshot 534eff1a-6871-4ae6-a219-6953794c6bb5 of volume 68afee35-0c3a-4a02-a7a1-732624739e26 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:05:15 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Volume volume-f7346afe-0a0c-414d-b4e8-7d831512d069 (f7346afe-0a0c-414d-b4e8-7d831512d069): created successfully Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b0c3fd-8373-4d1f-830e-89e852d1c554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Flow 'volume_create_manager' (92a197ef-d9f7-44b9-a83f-492a9152194c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafdad08-d1d7-460f-ba0d-a81f7084d654]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:15 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-9afbe5be-fdd3-485f-95b3-fd361106ad09 tempest-GroupsTest-1637030817 None] Created volume successfully. Nov 03 17:05:15 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 Nov 03 17:05:15 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:15 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26" returned: 0 in 0.428s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:15 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 1G Nov 03 17:05:15 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:16 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 1G" returned: 0 in 0.669s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68afee35-0c3a-4a02-a7a1-732624739e26 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:16 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68afee35-0c3a-4a02-a7a1-732624739e26 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 Nov 03 17:05:16 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:16 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68afee35-0c3a-4a02-a7a1-732624739e26 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5" returned: 0 in 0.425s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:16 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:05:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:16 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 Nov 03 17:05:16 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:17 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:17 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Acquiring lock "cinder-quobyte-f7346afe-0a0c-414d-b4e8-7d831512d069" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5" returned: 0 in 0.309s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:17 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Lock "cinder-quobyte-f7346afe-0a0c-414d-b4e8-7d831512d069" acquired by "delete_volume" :: waited 0.051s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:17 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3d0cd1-384f-4ff4-8ce0-21d46b62a08b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:17 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.info Nov 03 17:05:17 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:17 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069 Nov 03 17:05:17 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:17 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.info" returned: 0 in 0.353s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:17 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:05:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:17 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.info Nov 03 17:05:17 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:17 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069" returned: 0 in 0.561s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:17 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069 Nov 03 17:05:17 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:18 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.info" returned: 0 in 0.530s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:18 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-efd7e5e4-dbde-424d-a3c2-6ae4c0dfd0f0 tempest-GroupSnapshotsTest-625850232 None] group_snapshot 216ec12b-c22e-4512-8076-b33448f0dcef: created successfully Nov 03 17:05:18 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f7346afe-0a0c-414d-b4e8-7d831512d069" returned: 0 in 0.574s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Lock "cinder-quobyte-f7346afe-0a0c-414d-b4e8-7d831512d069" released by "delete_volume" :: held 1.228s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Created reservations ['11a84355-cad3-4ebc-a9ec-c2e091d60fa4'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:18 devstack cinder-volume[86661]: WARNING cinder.quota [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1593864494 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1593864494, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:18 devstack cinder-volume[86661]: WARNING cinder.quota [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1593864494 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1593864494, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Created reservations ['7779f880-feac-4992-9f43-f12cd85f37d3', 'b8298c8d-8cee-434f-a5c3-02cff49e3bb5', '69f23e3a-5c8f-4126-868a-3b887dac2834', 'cc0eed90-0aa3-4deb-a438-c20e1d799c6a'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:18 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] group_snapshot 216ec12b-c22e-4512-8076-b33448f0dcef: deleting Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] group_snapshot 216ec12b-c22e-4512-8076-b33448f0dcef: deleting {{(pid=86661) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-68afee35-0c3a-4a02-a7a1-732624739e26" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-68afee35-0c3a-4a02-a7a1-732624739e26" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-534eff1a-6871-4ae6-a219-6953794c6bb5" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-534eff1a-6871-4ae6-a219-6953794c6bb5" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:18 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:05:18 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Deleting offline snapshot 534eff1a-6871-4ae6-a219-6953794c6bb5 of volume 68afee35-0c3a-4a02-a7a1-732624739e26 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] snapshot_file for this snap is: volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[066f6a51-6c2b-49b4-8ace-cae5c12baf2c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:19 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 Nov 03 17:05:19 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:19 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.541s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:19 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-87d58f2a-ae23-4f8e-8dc9-fe3758ee501d tempest-GroupsTest-1637030817 None] Delete group completed successfully. Nov 03 17:05:19 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5" returned: 0 in 0.497s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68afee35-0c3a-4a02-a7a1-732624739e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f300753-5c45-405a-8669-e0f8150b906f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:19 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 Nov 03 17:05:19 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-256b3630-5934-4833-b7dc-b6a458cbdcc4 tempest-GroupsTest-1637030817 None] Created reservations ['d74748ec-6e67-44b6-b6d5-565b192d75ad'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-256b3630-5934-4833-b7dc-b6a458cbdcc4 tempest-GroupsTest-1637030817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-256b3630-5934-4833-b7dc-b6a458cbdcc4 tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-256b3630-5934-4833-b7dc-b6a458cbdcc4 tempest-GroupsTest-1637030817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-256b3630-5934-4833-b7dc-b6a458cbdcc4 tempest-GroupsTest-1637030817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-256b3630-5934-4833-b7dc-b6a458cbdcc4 tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-256b3630-5934-4833-b7dc-b6a458cbdcc4 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:20 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:05:20 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:20 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26" returned: 0 in 0.445s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:20 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 Nov 03 17:05:20 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:20 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-256b3630-5934-4833-b7dc-b6a458cbdcc4 tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.310s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:20 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-256b3630-5934-4833-b7dc-b6a458cbdcc4 tempest-GroupsTest-1637030817 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:20 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-256b3630-5934-4833-b7dc-b6a458cbdcc4 tempest-GroupsTest-1637030817 None] Delete group completed successfully. Nov 03 17:05:20 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5" returned: 0 in 0.360s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:20 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5 Nov 03 17:05:20 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:20 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26.534eff1a-6871-4ae6-a219-6953794c6bb5" returned: 0 in 0.278s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-534eff1a-6871-4ae6-a219-6953794c6bb5" released by "_delete_snapshot" :: held 1.830s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-68afee35-0c3a-4a02-a7a1-732624739e26" released by "delete_snapshot" :: held 1.879s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:20 devstack cinder-volume[86661]: WARNING cinder.quota [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1621633107 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1621633107, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:20 devstack cinder-volume[86661]: WARNING cinder.quota [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1621633107 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1621633107, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:20 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] Created reservations ['79d7ecca-0c5f-459d-91fb-8e38bdce21c5', 'dc6fcb49-02e2-4cdd-bf09-fc6364a5a493', '26abce84-98e5-4b25-b765-8fddc4d6ef4a', 'dc7de231-693a-4c87-bd5c-31a419bd519a'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-96b59c49-2299-430d-b961-08ea9365cd26 tempest-GroupSnapshotsTest-625850232 None] group_snapshot 216ec12b-c22e-4512-8076-b33448f0dcef: deleted successfully Nov 03 17:05:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-13139d11-2065-411f-a327-7b6d4dfdc2a7 tempest-GroupsTest-1637030817 None] Group tempest-GroupsTest-Group-1317410301: creating Nov 03 17:05:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "cinder-quobyte-68afee35-0c3a-4a02-a7a1-732624739e26" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-68afee35-0c3a-4a02-a7a1-732624739e26" acquired by "delete_volume" :: waited 0.042s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-13139d11-2065-411f-a327-7b6d4dfdc2a7 tempest-GroupsTest-1637030817 None] Group tempest-GroupsTest-Group-1317410301: created successfully Nov 03 17:05:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-13139d11-2065-411f-a327-7b6d4dfdc2a7 tempest-GroupsTest-1637030817 None] Create group completed successfully. Nov 03 17:05:21 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae5ece4-16a0-4c61-84ed-bcf106e37153]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:22 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 Nov 03 17:05:22 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:22 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26" returned: 0 in 0.520s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:22 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26 Nov 03 17:05:22 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:22 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-68afee35-0c3a-4a02-a7a1-732624739e26" returned: 0 in 0.261s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Lock "cinder-quobyte-68afee35-0c3a-4a02-a7a1-732624739e26" released by "delete_volume" :: held 0.922s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:22 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Created reservations ['0264cda3-2276-4174-b331-a7d8ad4228f0'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:22 devstack cinder-volume[86661]: WARNING cinder.quota [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1621633107 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1621633107, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:22 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Created reservations ['a5ef6588-720a-42bf-a1e5-667a0920d3db', '541a1b6a-b1e3-4802-ac23-9ce600e8bde5', '227188d3-a87c-47d0-a8d8-217488fe2091', '7758e6b4-c077-46ae-a891-645cf8dfdd00'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:23 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:05:23 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:23 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.516s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:23 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d78a4ac9-79f2-42aa-bd72-eec5425b59ce tempest-GroupSnapshotsTest-625850232 None] Delete group completed successfully. Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=183,cinder:SELECT=189,cinder:INSERT=48,cinder:DELETE=5 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Flow 'volume_create_manager' (97ec51d2-8d10-4e31-a8d6-0191c1f7cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bd3b80-43ba-4e47-bd33-0434c45d9a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bd3b80-43ba-4e47-bd33-0434c45d9a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-81086161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a646d45-e8be-4366-84a7-de5078e7a086,host='devstack@QuobyteHD#QuobyteHD',id=d62b1efd-19e2-4fba-a385-51b0e2d6b665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0098b504ead649178ecf7dd78da32233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:24Z,use_quota=True,user_id='5b3a5a5fb1e2434bbfc81139dfae60cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d422eea-7f94-435f-9399-7556f3f49fb8),volume_type_id=2d422eea-7f94-435f-9399-7556f3f49fb8)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98446a6a-1461-407d-81d0-2f4945527156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98446a6a-1461-407d-81d0-2f4945527156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a62e05-a78f-4c39-89b3-f1b3773eed92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a62e05-a78f-4c39-89b3-f1b3773eed92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62b1efd-19e2-4fba-a385-51b0e2d6b665', 'volume_name': 'volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c710133-e7ed-42ea-a04d-70d2b371702c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c710133-e7ed-42ea-a04d-70d2b371702c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e72808-f140-475e-b0d3-07ff44120112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:23 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Volume d62b1efd-19e2-4fba-a385-51b0e2d6b665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665', 'volume_size': 1} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a646d45-e8be-4366-84a7-de5078e7a086,created_at=2026-11-03T16:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-81086161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a646d45-e8be-4366-84a7-de5078e7a086,host='devstack@QuobyteHD#QuobyteHD',id=d62b1efd-19e2-4fba-a385-51b0e2d6b665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0098b504ead649178ecf7dd78da32233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:24Z,use_quota=True,user_id='5b3a5a5fb1e2434bbfc81139dfae60cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d422eea-7f94-435f-9399-7556f3f49fb8),volume_type_id=2d422eea-7f94-435f-9399-7556f3f49fb8)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Creating volume d62b1efd-19e2-4fba-a385-51b0e2d6b665 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:23 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:05:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:23 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665 1073741824 Nov 03 17:05:23 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:24 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665 1073741824" returned: 0 in 0.671s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:24 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665 Nov 03 17:05:24 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:24 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665" returned: 0 in 0.315s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e72808-f140-475e-b0d3-07ff44120112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cec1c52-90e3-44d4-85b6-fdb8cabf7dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:24 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Volume volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665 (d62b1efd-19e2-4fba-a385-51b0e2d6b665): created successfully Nov 03 17:05:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cec1c52-90e3-44d4-85b6-fdb8cabf7dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Flow 'volume_create_manager' (97ec51d2-8d10-4e31-a8d6-0191c1f7cf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-599b2a82-42da-46a9-8390-5519158dbf95 tempest-GroupsTest-1637030817 None] Created volume successfully. Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Flow 'volume_create_manager' (35d7beee-4c60-4157-befd-3c334b321f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a8379a-f37f-4f4e-91c8-dd7cda484ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a8379a-f37f-4f4e-91c8-dd7cda484ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681803203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a646d45-e8be-4366-84a7-de5078e7a086,host='devstack@QuobyteHD#QuobyteHD',id=cc32fe9b-87dc-4089-9dd9-9269ab854542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0098b504ead649178ecf7dd78da32233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:27Z,use_quota=True,user_id='5b3a5a5fb1e2434bbfc81139dfae60cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d422eea-7f94-435f-9399-7556f3f49fb8),volume_type_id=2d422eea-7f94-435f-9399-7556f3f49fb8)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b60c37-652e-45b0-a897-72faee817e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b60c37-652e-45b0-a897-72faee817e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4535c613-6994-4a0c-8aad-13cb260aa8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4535c613-6994-4a0c-8aad-13cb260aa8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc32fe9b-87dc-4089-9dd9-9269ab854542', 'volume_name': 'volume-cc32fe9b-87dc-4089-9dd9-9269ab854542', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec67add-b7d4-4f9a-bfca-120f34a7d1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec67add-b7d4-4f9a-bfca-120f34a7d1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2f3115-9ea5-4ff3-8150-0d64cafa1fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:27 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Volume cc32fe9b-87dc-4089-9dd9-9269ab854542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc32fe9b-87dc-4089-9dd9-9269ab854542', 'volume_size': 1} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a646d45-e8be-4366-84a7-de5078e7a086,created_at=2026-11-03T16:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681803203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a646d45-e8be-4366-84a7-de5078e7a086,host='devstack@QuobyteHD#QuobyteHD',id=cc32fe9b-87dc-4089-9dd9-9269ab854542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0098b504ead649178ecf7dd78da32233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:27Z,use_quota=True,user_id='5b3a5a5fb1e2434bbfc81139dfae60cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d422eea-7f94-435f-9399-7556f3f49fb8),volume_type_id=2d422eea-7f94-435f-9399-7556f3f49fb8)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Creating volume cc32fe9b-87dc-4089-9dd9-9269ab854542 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:27 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:27 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542 1073741824 Nov 03 17:05:27 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:27 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542 1073741824" returned: 0 in 0.498s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:28 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542 Nov 03 17:05:28 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:28 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542" returned: 0 in 0.277s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2f3115-9ea5-4ff3-8150-0d64cafa1fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc32fe9b-87dc-4089-9dd9-9269ab854542', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a48e29-49a3-48ee-8ddb-cd5f8d2e27a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:28 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Volume volume-cc32fe9b-87dc-4089-9dd9-9269ab854542 (cc32fe9b-87dc-4089-9dd9-9269ab854542): created successfully Nov 03 17:05:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a48e29-49a3-48ee-8ddb-cd5f8d2e27a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Flow 'volume_create_manager' (35d7beee-4c60-4157-befd-3c334b321f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:28 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-04c17e6a-a969-48af-a18f-2b42ce07a998 tempest-GroupsTest-1637030817 None] Created volume successfully. Nov 03 17:05:28 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-24b4243f-5324-4e4d-8928-61700b268f6a tempest-GroupsTest-1637030817 None] Update group completed successfully. Nov 03 17:05:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:05:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:29 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:05:29 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:30 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.391s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:05:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:05:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:05:30 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=136,cinder:SELECT=152,cinder:INSERT=35,cinder:DELETE=4 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:05:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-012d3981-e3cd-42ec-a075-fc6536b65191 tempest-GroupsTest-1637030817 None] Update group completed successfully. Nov 03 17:05:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Acquiring lock "cinder-quobyte-cc32fe9b-87dc-4089-9dd9-9269ab854542" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Lock "cinder-quobyte-cc32fe9b-87dc-4089-9dd9-9269ab854542" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:32 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[375cc273-d2d5-4651-a764-3e51d9c82a51]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:32 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542 Nov 03 17:05:32 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-85bb472a-8820-4549-a3ac-a0948e3f8274 tempest-ServerActionsTestOtherA-894703843 None] Terminate volume connection completed successfully. Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-85bb472a-8820-4549-a3ac-a0948e3f8274 tempest-ServerActionsTestOtherA-894703843 None] Deleting attachment 0930e93a-0f34-428a-969b-a3f11852a7dd. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "cinder-4974fd90-6739-4629-ba01-378dd8f2abf1-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:33 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542" returned: 0 in 0.548s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Lock "cinder-4974fd90-6739-4629-ba01-378dd8f2abf1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:33 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542 Nov 03 17:05:33 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "cinder-quobyte-4974fd90-6739-4629-ba01-378dd8f2abf1" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Lock "cinder-quobyte-4974fd90-6739-4629-ba01-378dd8f2abf1" acquired by "delete_volume" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c7bf0a-b0af-4c66-85d0-5b9314f4024a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:33 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cc32fe9b-87dc-4089-9dd9-9269ab854542" returned: 0 in 0.329s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:33 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 Nov 03 17:05:33 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Lock "cinder-quobyte-cc32fe9b-87dc-4089-9dd9-9269ab854542" released by "delete_volume" :: held 0.965s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Acquiring lock "cinder-quobyte-d62b1efd-19e2-4fba-a385-51b0e2d6b665" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Lock "cinder-quobyte-d62b1efd-19e2-4fba-a385-51b0e2d6b665" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad18229-9743-4779-b4ac-2fbe74c0ba37]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:33 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665 Nov 03 17:05:33 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:33 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1" returned: 0 in 0.515s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:34 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1 Nov 03 17:05:34 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:34 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665" returned: 0 in 0.478s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:34 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665 Nov 03 17:05:34 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:34 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4974fd90-6739-4629-ba01-378dd8f2abf1" returned: 0 in 0.327s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Lock "cinder-quobyte-4974fd90-6739-4629-ba01-378dd8f2abf1" released by "delete_volume" :: held 0.909s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.quota [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Created reservations ['3ea2ee94-3e67-41db-a87b-31dffb856c62', 'd2a04791-4604-441a-89df-817ae71de0e6', 'f39fee9d-7b24-4a44-a345-130f184e7c38', '5e0c990b-2369-4cfd-aeae-82c30f384617'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:34 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d62b1efd-19e2-4fba-a385-51b0e2d6b665" returned: 0 in 0.269s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Lock "cinder-quobyte-d62b1efd-19e2-4fba-a385-51b0e2d6b665" released by "delete_volume" :: held 0.823s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:34 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:05:34 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Created reservations ['8599284f-a2b1-4afa-b23b-ed98632a4d2c'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:34 devstack cinder-volume[86661]: WARNING cinder.quota [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1240511710 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1240511710, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:34 devstack cinder-volume[86661]: WARNING cinder.quota [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1240511710 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1240511710, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Created reservations ['9e5cfe11-c942-44af-a6cf-3041410aed1e', 'b3bedfee-3e0f-409f-8dd2-8a1c95c087e4', '29d0bbc8-b0ed-42ba-bb2e-97c75121c715', '9d7e8d65-56f8-4d1a-9c6e-fcbb9927f1b3'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "cinder-414b9723-ca47-4dd4-812e-8fa54a880e0e-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Lock "cinder-414b9723-ca47-4dd4-812e-8fa54a880e0e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "cinder-quobyte-414b9723-ca47-4dd4-812e-8fa54a880e0e" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Lock "cinder-quobyte-414b9723-ca47-4dd4-812e-8fa54a880e0e" acquired by "delete_volume" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:34 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.419s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Created reservations ['11dc0e3c-b238-493e-8ccc-a40a005c3010', '687ad376-de22-41af-9a78-e015a7e55c17', '0ba9bb25-4ea0-4bd0-a229-30da090c2a47', '5443000f-12de-4185-9a17-68f082a1aef0'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.manager [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3480f8e-381b-43d9-af0d-366711beee23]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:34 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Deleted volume successfully. Nov 03 17:05:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-19563f32-96c4-41c2-b277-a5f3353ee714 req-06e93c87-f688-425d-b923-3dbf4125a6b2 tempest-ServerActionsTestOtherA-894703843 None] Lock "cinder-4974fd90-6739-4629-ba01-378dd8f2abf1-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:35 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e Nov 03 17:05:35 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:35 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:05:35 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:35 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:35 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.303s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e" returned: 0 in 0.476s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:35 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-efb5c39d-811f-4106-986b-2ad8840ee407 tempest-GroupsTest-1637030817 None] Delete group completed successfully. Nov 03 17:05:35 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e Nov 03 17:05:35 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:35 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-414b9723-ca47-4dd4-812e-8fa54a880e0e" returned: 0 in 0.278s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Lock "cinder-quobyte-414b9723-ca47-4dd4-812e-8fa54a880e0e" released by "delete_volume" :: held 0.832s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Created reservations ['7f3e789c-da5e-49d9-97ad-31b74878c488', '5497c481-8055-4b7c-8423-3d2054b87e88', 'a91ce697-c7f2-4812-badd-166a549a5189', '951e727d-5cb2-4f38-b5e6-ff02a815e612'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:35 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:05:35 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:36 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.344s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:36 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Deleted volume successfully. Nov 03 17:05:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a9e7731-3a19-4b17-8c3e-5da9ce23fef6 tempest-ServerActionsTestOtherA-894703843 None] Lock "cinder-414b9723-ca47-4dd4-812e-8fa54a880e0e-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Flow 'volume_create_manager' (e40d12ab-998d-4d8c-8a20-5c139cafd99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940cf11d-f14c-4c70-96d8-70c5e5ec1cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940cf11d-f14c-4c70-96d8-70c5e5ec1cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1660725234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c7635b-7553-4d93-aff1-b1ae4f18d720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b133de72c74fda91907fe808bd5f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:43Z,use_quota=True,user_id='f7569865282447f19ecbbb55f7b64094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07991dd1-7e6a-4902-a8fe-50f6fdb4540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07991dd1-7e6a-4902-a8fe-50f6fdb4540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e00fb1f-2638-4d55-8ad0-b55f93ffa202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e00fb1f-2638-4d55-8ad0-b55f93ffa202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c7635b-7553-4d93-aff1-b1ae4f18d720', 'volume_name': 'volume-98c7635b-7553-4d93-aff1-b1ae4f18d720', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d9eb78-bf59-4abc-ba88-319865c5193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d9eb78-bf59-4abc-ba88-319865c5193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fb9f10-117e-47a3-bd0b-e80acb1e76ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:42 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Volume 98c7635b-7553-4d93-aff1-b1ae4f18d720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c7635b-7553-4d93-aff1-b1ae4f18d720', 'volume_size': 1} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1660725234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c7635b-7553-4d93-aff1-b1ae4f18d720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b133de72c74fda91907fe808bd5f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:43Z,use_quota=True,user_id='f7569865282447f19ecbbb55f7b64094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Creating volume 98c7635b-7553-4d93-aff1-b1ae4f18d720 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:42 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:05:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:42 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720 1073741824 Nov 03 17:05:42 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:43 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720 1073741824" returned: 0 in 0.613s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:43 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720 Nov 03 17:05:43 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:43 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720" returned: 0 in 0.332s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4fb9f10-117e-47a3-bd0b-e80acb1e76ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c7635b-7553-4d93-aff1-b1ae4f18d720', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef1dfe1-8ea8-4ccc-a596-c100a57b5254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:43 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Volume volume-98c7635b-7553-4d93-aff1-b1ae4f18d720 (98c7635b-7553-4d93-aff1-b1ae4f18d720): created successfully Nov 03 17:05:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef1dfe1-8ea8-4ccc-a596-c100a57b5254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Flow 'volume_create_manager' (e40d12ab-998d-4d8c-8a20-5c139cafd99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:43 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5998ab31-fc03-4fe4-9238-3639d7ee2f3f tempest-AttachVolumeNegativeTest-1504269075 None] Created volume successfully. Nov 03 17:05:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-386f2073-b523-4213-afbb-62fe9da0f737 req-8fa0f48c-3eb2-4d10-865b-b798250036df tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-386f2073-b523-4213-afbb-62fe9da0f737 req-8fa0f48c-3eb2-4d10-865b-b798250036df tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-386f2073-b523-4213-afbb-62fe9da0f737 req-8fa0f48c-3eb2-4d10-865b-b798250036df tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-386f2073-b523-4213-afbb-62fe9da0f737 req-8fa0f48c-3eb2-4d10-865b-b798250036df tempest-AttachVolumeNegativeTest-1504269075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-98c7635b-7553-4d93-aff1-b1ae4f18d720', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e97fe49-bd91-4073-b734-5ae7610fd8f3', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:05:45 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-386f2073-b523-4213-afbb-62fe9da0f737 req-8fa0f48c-3eb2-4d10-865b-b798250036df tempest-AttachVolumeNegativeTest-1504269075 None] attachment_update completed successfully. Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Flow 'volume_create_manager' (0f6ad8d5-26fb-4688-93e7-4e5a140713f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26691762-bc38-427b-b517-1fc2f5d1789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26691762-bc38-427b-b517-1fc2f5d1789e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-206255740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a65b1c-8967-4451-a05b-e48d00540376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7349dd71bbd64c0bb47ad33a9225760c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:51Z,use_quota=True,user_id='92726db31f7847e2b7668d16bda27666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9646a1fa-24ef-4f7e-b033-7fdbebd3b1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9646a1fa-24ef-4f7e-b033-7fdbebd3b1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc17d1ef-0e63-46a4-8179-6132be421816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc17d1ef-0e63-46a4-8179-6132be421816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a65b1c-8967-4451-a05b-e48d00540376', 'volume_name': 'volume-f6a65b1c-8967-4451-a05b-e48d00540376', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc4f850-97c8-4016-b3f6-3cbb61c1e368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc4f850-97c8-4016-b3f6-3cbb61c1e368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e17e3fb-0e04-49ee-900b-15150fab3bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:51 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Volume f6a65b1c-8967-4451-a05b-e48d00540376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a65b1c-8967-4451-a05b-e48d00540376', 'volume_size': 1} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-206255740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a65b1c-8967-4451-a05b-e48d00540376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7349dd71bbd64c0bb47ad33a9225760c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:51Z,use_quota=True,user_id='92726db31f7847e2b7668d16bda27666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Creating volume f6a65b1c-8967-4451-a05b-e48d00540376 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:51 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:51 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 1073741824 Nov 03 17:05:51 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:51 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 1073741824" returned: 0 in 0.599s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:52 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 Nov 03 17:05:52 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:52 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376" returned: 0 in 0.329s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e17e3fb-0e04-49ee-900b-15150fab3bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a65b1c-8967-4451-a05b-e48d00540376', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c0e6fb-ce07-41fa-bf0c-73472bc4cfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:52 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Volume volume-f6a65b1c-8967-4451-a05b-e48d00540376 (f6a65b1c-8967-4451-a05b-e48d00540376): created successfully Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c0e6fb-ce07-41fa-bf0c-73472bc4cfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Flow 'volume_create_manager' (0f6ad8d5-26fb-4688-93e7-4e5a140713f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:52 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-bc598757-416d-442d-a025-f52b37be4e54 req-3696ac91-8b38-443a-a721-b1d40fecb0b9 tempest-VolumesSnapshotsTestJSON-846392988 None] Created volume successfully. Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Flow 'volume_create_manager' (e27f5b8a-cafa-4d28-9da6-89cc817d2854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed84e7d-616f-4b59-a57e-b1fa4b29a7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed84e7d-616f-4b59-a57e-b1fa4b29a7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1085423641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a520d3e2-7f18-47ce-a7aa-99863924de6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844fffb5e1dc4706ac3585b63783acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:52Z,use_quota=True,user_id='3c9fd302889a466db50248e67d112385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd88afd-7b89-4107-b64e-76dc79f07b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd88afd-7b89-4107-b64e-76dc79f07b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cb1aaf-37a7-4de5-bb77-f48f0ef9943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cb1aaf-37a7-4de5-bb77-f48f0ef9943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a520d3e2-7f18-47ce-a7aa-99863924de6b', 'volume_name': 'volume-a520d3e2-7f18-47ce-a7aa-99863924de6b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec480923-9f40-482b-b012-c105ed7e1098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec480923-9f40-482b-b012-c105ed7e1098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d558e30-ba8a-4a66-81da-bf322e7f6c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:52 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Volume a520d3e2-7f18-47ce-a7aa-99863924de6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a520d3e2-7f18-47ce-a7aa-99863924de6b', 'volume_size': 1} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1085423641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a520d3e2-7f18-47ce-a7aa-99863924de6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844fffb5e1dc4706ac3585b63783acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:52Z,use_quota=True,user_id='3c9fd302889a466db50248e67d112385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Creating volume a520d3e2-7f18-47ce-a7aa-99863924de6b {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:52 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:05:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:52 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b 1073741824 Nov 03 17:05:52 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:53 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b 1073741824" returned: 0 in 0.572s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:53 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b Nov 03 17:05:53 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:53 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b" returned: 0 in 0.354s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d558e30-ba8a-4a66-81da-bf322e7f6c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a520d3e2-7f18-47ce-a7aa-99863924de6b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a2f5ef-3212-482e-8559-d733191bf2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:53 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Volume volume-a520d3e2-7f18-47ce-a7aa-99863924de6b (a520d3e2-7f18-47ce-a7aa-99863924de6b): created successfully Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a2f5ef-3212-482e-8559-d733191bf2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Flow 'volume_create_manager' (e27f5b8a-cafa-4d28-9da6-89cc817d2854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:53 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b33f71d3-d917-41ff-9941-d01e66e130c7 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Created volume successfully. Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] Creating offline snapshot 0b781c18-7ef0-4644-ab33-bdd1ac6fa610 of volume f6a65b1c-8967-4451-a05b-e48d00540376 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[153e77b3-2d75-4955-8799-2acc5a94b02c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:54 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 Nov 03 17:05:54 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:54 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376" returned: 0 in 0.602s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:54 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 1G Nov 03 17:05:54 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Acquiring lock "cinder-a520d3e2-7f18-47ce-a7aa-99863924de6b-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "cinder-a520d3e2-7f18-47ce-a7aa-99863924de6b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Acquiring lock "cinder-quobyte-a520d3e2-7f18-47ce-a7aa-99863924de6b" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "cinder-quobyte-a520d3e2-7f18-47ce-a7aa-99863924de6b" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7249a3-bf03-40e7-8965-847c2c28351f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:55 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b Nov 03 17:05:55 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:55 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 1G" returned: 0 in 0.673s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a65b1c-8967-4451-a05b-e48d00540376 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:55 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a65b1c-8967-4451-a05b-e48d00540376 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 Nov 03 17:05:55 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:55 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b" returned: 0 in 0.440s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:55 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a65b1c-8967-4451-a05b-e48d00540376 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610" returned: 0 in 0.325s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:55 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 is being set with open permissions: ugo+rw Nov 03 17:05:55 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:55 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:55 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 Nov 03 17:05:55 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:55 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a520d3e2-7f18-47ce-a7aa-99863924de6b" returned: 0 in 0.324s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:55 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "cinder-quobyte-a520d3e2-7f18-47ce-a7aa-99863924de6b" released by "delete_volume" :: held 0.823s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610" returned: 0 in 0.327s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:55 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.info Nov 03 17:05:55 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:55 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Created reservations ['ad22cd5b-274a-4a59-8b10-974f70a355c1', '170823a8-55a1-44cd-a961-33919025403e', '51a3dd13-4df3-4152-8f11-197cbd41fae3', '120341f4-34bb-4370-b458-47d6bba4c872'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:56 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:05:56 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:56 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.info" returned: 0 in 0.393s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:56 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.info is being set with open permissions: ugo+rw Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:56 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.info Nov 03 17:05:56 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:56 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.378s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:05:56 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Deleted volume successfully. Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-91d88fe6-3a6c-4c5b-b8da-7f125e215f8c tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "cinder-a520d3e2-7f18-47ce-a7aa-99863924de6b-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:05:56 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.info" returned: 0 in 0.400s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:56 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-c1711ae9-270e-4c42-b867-40aa863d2705 req-42177dd4-0ae9-45e5-a167-b266c8b1701a tempest-VolumesSnapshotsTestJSON-846392988 None] Create snapshot completed successfully Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:05:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Flow 'volume_create_manager' (a8993e52-8737-423a-b50e-50ef4cbbf249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00533741-946e-4c28-8273-7211be668288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00533741-946e-4c28-8273-7211be668288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1250298182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ff13bc-3b2e-46f5-8170-a8d8943221dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844fffb5e1dc4706ac3585b63783acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:57Z,use_quota=True,user_id='3c9fd302889a466db50248e67d112385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58acedc8-1808-40cc-a548-6a68e2739dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58acedc8-1808-40cc-a548-6a68e2739dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5a48e6-4163-419a-9a61-efbb131ed2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5a48e6-4163-419a-9a61-efbb131ed2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ff13bc-3b2e-46f5-8170-a8d8943221dc', 'volume_name': 'volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee635e3-fb83-4140-b6c5-99b7f9ff8af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee635e3-fb83-4140-b6c5-99b7f9ff8af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388889d3-e41a-41b0-a850-86b7b1a32480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:57 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Volume 97ff13bc-3b2e-46f5-8170-a8d8943221dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc', 'volume_size': 1} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1250298182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ff13bc-3b2e-46f5-8170-a8d8943221dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844fffb5e1dc4706ac3585b63783acb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:05:57Z,use_quota=True,user_id='3c9fd302889a466db50248e67d112385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Creating volume 97ff13bc-3b2e-46f5-8170-a8d8943221dc {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:05:57 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:57 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc 1073741824 Nov 03 17:05:57 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Acquiring lock "cinder-0b781c18-7ef0-4644-ab33-bdd1ac6fa610-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "cinder-0b781c18-7ef0-4644-ab33-bdd1ac6fa610-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Acquiring lock "cinder-quobyte-f6a65b1c-8967-4451-a05b-e48d00540376" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "cinder-quobyte-f6a65b1c-8967-4451-a05b-e48d00540376" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Acquiring lock "cinder-quobyte-0b781c18-7ef0-4644-ab33-bdd1ac6fa610" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "cinder-quobyte-0b781c18-7ef0-4644-ab33-bdd1ac6fa610" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:05:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Deleting offline snapshot 0b781c18-7ef0-4644-ab33-bdd1ac6fa610 of volume f6a65b1c-8967-4451-a05b-e48d00540376 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:05:57 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] snapshot_file for this snap is: volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc 1073741824" returned: 0 in 0.829s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[705311ec-c151-4040-aec2-d7691b549cb2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:58 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc Nov 03 17:05:58 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:58 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 Nov 03 17:05:58 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:58 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc" returned: 0 in 0.300s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388889d3-e41a-41b0-a850-86b7b1a32480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cc4b44-a4ca-4eca-93fb-a63c2febac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:05:58 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Volume volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc (97ff13bc-3b2e-46f5-8170-a8d8943221dc): created successfully Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cc4b44-a4ca-4eca-93fb-a63c2febac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Flow 'volume_create_manager' (a8993e52-8737-423a-b50e-50ef4cbbf249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:05:58 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-23e647a6-c2eb-48c9-a268-e8841950d763 tempest-VolumeQuotasAdminTestJSON-2091723700 None] Created volume successfully. Nov 03 17:05:58 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610" returned: 0 in 0.632s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6a65b1c-8967-4451-a05b-e48d00540376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e68c70-c24c-4f37-a531-de067c7ad4f5]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:05:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:58 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 Nov 03 17:05:58 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:59 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376" returned: 0 in 0.625s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:05:59 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 Nov 03 17:05:59 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:05:59 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Nov 03 17:05:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610" returned: 0 in 0.565s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:05:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:00 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610 Nov 03 17:06:00 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:00 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-774a6ebe-21a2-42a6-a3b3-f1767519335c tempest-VolumeQuotasAdminTestJSON-565921970 None] Transfer volume completed successfully. Nov 03 17:06:00 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376.0b781c18-7ef0-4644-ab33-bdd1ac6fa610" returned: 0 in 0.623s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "cinder-quobyte-0b781c18-7ef0-4644-ab33-bdd1ac6fa610" released by "_delete_snapshot" :: held 2.669s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "cinder-quobyte-f6a65b1c-8967-4451-a05b-e48d00540376" released by "delete_snapshot" :: held 2.711s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:00 devstack cinder-volume[86661]: WARNING cinder.quota [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:06:00 devstack cinder-volume[86661]: DEBUG cinder.quota [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Created reservations ['f52ac59e-730f-4f84-bd6f-e048300163b2', 'ac7629fc-5581-4a61-822f-50dde5c8cf8b', 'e2430b07-9110-4ccf-b4ba-d8a8dcd44922', '267356c7-f962-454b-90bf-1a693288173d'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:01 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Delete snapshot completed successfully. Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Acquiring lock "cinder-97ff13bc-3b2e-46f5-8170-a8d8943221dc-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-db2e0641-a0b6-4837-9ff6-b4d1941e35e4 req-a25e1ea1-3566-4dfc-b561-60cc0a746554 tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "cinder-0b781c18-7ef0-4644-ab33-bdd1ac6fa610-delete_snapshot" released by "delete_snapshot" :: held 3.102s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Lock "cinder-97ff13bc-3b2e-46f5-8170-a8d8943221dc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Acquiring lock "cinder-quobyte-97ff13bc-3b2e-46f5-8170-a8d8943221dc" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Lock "cinder-quobyte-97ff13bc-3b2e-46f5-8170-a8d8943221dc" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[04721618-41ec-4073-a1ab-e517dbdbd33f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:01 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc Nov 03 17:06:01 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Acquiring lock "cinder-f6a65b1c-8967-4451-a05b-e48d00540376-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "cinder-f6a65b1c-8967-4451-a05b-e48d00540376-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Acquiring lock "cinder-quobyte-f6a65b1c-8967-4451-a05b-e48d00540376" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "cinder-quobyte-f6a65b1c-8967-4451-a05b-e48d00540376" acquired by "delete_volume" :: waited 0.045s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed894b6-a57a-4a22-9112-accdfc631dcf]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:02 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 Nov 03 17:06:02 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:02 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc" returned: 0 in 0.947s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:02 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc Nov 03 17:06:02 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:02 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376" returned: 0 in 0.677s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:02 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376 Nov 03 17:06:02 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:02 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-97ff13bc-3b2e-46f5-8170-a8d8943221dc" returned: 0 in 0.633s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Lock "cinder-quobyte-97ff13bc-3b2e-46f5-8170-a8d8943221dc" released by "delete_volume" :: held 1.666s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:02 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Created reservations ['82a6d6ff-e22c-4b5c-a106-2693215ae568', 'b405266e-42d7-46b6-a9bc-8bad7ad0b561', '81e139b4-5e42-4a23-8504-5224a7f0626c', '3776f63e-ed28-475a-a954-92f817639d18'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:02 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f6a65b1c-8967-4451-a05b-e48d00540376" returned: 0 in 0.451s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "cinder-quobyte-f6a65b1c-8967-4451-a05b-e48d00540376" released by "delete_volume" :: held 1.304s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:03 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:06:03 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG cinder.quota [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Created reservations ['25304dfc-3715-4c8c-8fcf-0e5cc7bd6f52', 'ce729817-f4fb-4505-a972-27996a4f3c3b', '355b7e3d-0315-41f3-b7af-edab6da46e16', 'a047b484-2dae-4db4-afea-f66db59ffd93'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:03 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:06:03 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:03 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.388s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:03 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Deleted volume successfully. Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5935df30-8e30-44eb-9776-54a4db9d353b tempest-VolumeQuotasAdminTestJSON-1913947673 None] Lock "cinder-97ff13bc-3b2e-46f5-8170-a8d8943221dc-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:03 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.503s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG cinder.manager [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:03 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Deleted volume successfully. Nov 03 17:06:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-2b8b5683-e237-4166-9928-9408bf3cc0c2 req-885646cf-e47e-404d-afc1-680d1553629b tempest-VolumesSnapshotsTestJSON-846392988 None] Lock "cinder-f6a65b1c-8967-4451-a05b-e48d00540376-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:11 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Flow 'volume_create_manager' (06cf8f4e-85a4-4240-8a1f-363a4bee958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ea2dd4-feec-4fd2-ab99-243700ac3b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ea2dd4-feec-4fd2-ab99-243700ac3b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-181313431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17cf45d-52dd-40a9-bea2-376ee90f6ef3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae20ea47000497fa84ce1f8632479a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:12Z,use_quota=True,user_id='aa87c298d5164fd8a4352a5e829579ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7fcc1d-1c25-472d-a79b-d66887cc2cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7fcc1d-1c25-472d-a79b-d66887cc2cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b0eee0-4b61-4392-b086-0e9f23013bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b0eee0-4b61-4392-b086-0e9f23013bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17cf45d-52dd-40a9-bea2-376ee90f6ef3', 'volume_name': 'volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350d40f7-a308-4a2c-96e8-2c3ceda5d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350d40f7-a308-4a2c-96e8-2c3ceda5d946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2100bc-6eaa-485e-8e22-7cf1ab79c41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:12 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Volume b17cf45d-52dd-40a9-bea2-376ee90f6ef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3', 'volume_size': 1} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-181313431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17cf45d-52dd-40a9-bea2-376ee90f6ef3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae20ea47000497fa84ce1f8632479a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:12Z,use_quota=True,user_id='aa87c298d5164fd8a4352a5e829579ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Creating volume b17cf45d-52dd-40a9-bea2-376ee90f6ef3 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:12 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:12 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3 1073741824 Nov 03 17:06:12 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Flow 'volume_create_manager' (fde76aed-d75c-4415-95af-e188a5801fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8018de9c-d7ab-4aea-9ff7-f087d4199c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8018de9c-d7ab-4aea-9ff7-f087d4199c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-400286342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a70216-92ee-4f96-8fba-7351a167ef2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86a35cb804842838d376890e9cb9e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:12Z,use_quota=True,user_id='dd86ee55656f4ff1bced2ab05e7b5837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e8adef-27f8-4316-af96-45c513a3bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e8adef-27f8-4316-af96-45c513a3bee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19baa839-3a5d-4e6e-93d6-97e5faf94d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19baa839-3a5d-4e6e-93d6-97e5faf94d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a70216-92ee-4f96-8fba-7351a167ef2e', 'volume_name': 'volume-f1a70216-92ee-4f96-8fba-7351a167ef2e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c975f24-3f1a-41e6-bce5-af99e5f1afa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c975f24-3f1a-41e6-bce5-af99e5f1afa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca35b49-9976-4622-a9e6-c9c0acbc0a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:12 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Volume f1a70216-92ee-4f96-8fba-7351a167ef2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a70216-92ee-4f96-8fba-7351a167ef2e', 'volume_size': 1} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:12 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3 1073741824" returned: 0 in 0.586s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:12 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3 Nov 03 17:06:12 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:12 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3" returned: 0 in 0.260s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.491s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-400286342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a70216-92ee-4f96-8fba-7351a167ef2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86a35cb804842838d376890e9cb9e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:12Z,use_quota=True,user_id='dd86ee55656f4ff1bced2ab05e7b5837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Creating volume f1a70216-92ee-4f96-8fba-7351a167ef2e {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:12 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2100bc-6eaa-485e-8e22-7cf1ab79c41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:12 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e 1073741824 Nov 03 17:06:12 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860a40bc-1448-4f35-a243-abd019d83c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:12 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Volume volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3 (b17cf45d-52dd-40a9-bea2-376ee90f6ef3): created successfully Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860a40bc-1448-4f35-a243-abd019d83c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Flow 'volume_create_manager' (06cf8f4e-85a4-4240-8a1f-363a4bee958a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:13 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8be6165b-9e85-4614-aae2-53d5a2179668 tempest-VolumesTestJSON-28217862 None] Created volume successfully. Nov 03 17:06:13 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e 1073741824" returned: 0 in 0.499s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:13 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e Nov 03 17:06:13 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:13 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e" returned: 0 in 0.254s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca35b49-9976-4622-a9e6-c9c0acbc0a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a70216-92ee-4f96-8fba-7351a167ef2e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03cfed1-9138-4705-98ed-960ec91237f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:13 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Volume volume-f1a70216-92ee-4f96-8fba-7351a167ef2e (f1a70216-92ee-4f96-8fba-7351a167ef2e): created successfully Nov 03 17:06:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03cfed1-9138-4705-98ed-960ec91237f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Flow 'volume_create_manager' (fde76aed-d75c-4415-95af-e188a5801fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:13 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-0f700c4e-1f1c-4769-8b93-f3c4018d02fa tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Created volume successfully. Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Flow 'volume_create_manager' (da806011-b714-4a7f-99c7-2e543cca715f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac4c98f-d9d5-46d2-89b5-a4bafbdb821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac4c98f-d9d5-46d2-89b5-a4bafbdb821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1427900709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fd575f-e79a-462e-a4aa-aa35adf3253c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae20ea47000497fa84ce1f8632479a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:14Z,use_quota=True,user_id='aa87c298d5164fd8a4352a5e829579ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc96d686-3e26-431d-a02c-64a776bc24a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc96d686-3e26-431d-a02c-64a776bc24a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bb4264-8f90-4fe7-be66-f9a07c3e819e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bb4264-8f90-4fe7-be66-f9a07c3e819e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fd575f-e79a-462e-a4aa-aa35adf3253c', 'volume_name': 'volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a724477-53d3-432a-a6aa-742f3a64da97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a724477-53d3-432a-a6aa-742f3a64da97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ed2ef3-118d-4142-b78f-fecdcc41c4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:14 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Volume c2fd575f-e79a-462e-a4aa-aa35adf3253c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c', 'volume_size': 1} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1427900709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fd575f-e79a-462e-a4aa-aa35adf3253c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae20ea47000497fa84ce1f8632479a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:14Z,use_quota=True,user_id='aa87c298d5164fd8a4352a5e829579ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Creating volume c2fd575f-e79a-462e-a4aa-aa35adf3253c {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:14 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:14 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c 1073741824 Nov 03 17:06:14 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:14 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Flow 'volume_create_manager' (ab647bf3-b40a-4526-82af-c001a1c06fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1426db37-0f2a-4949-ae9b-dce650ea736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1426db37-0f2a-4949-ae9b-dce650ea736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1604736278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889e88de-5b03-43d2-b347-46c50fcb8439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a5eec9b32c46bcafaf06e3eb3e0cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:15Z,use_quota=True,user_id='e22620ad0f48483f9c903d162612ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95fd9e4-175b-4651-b762-c81cc77fd161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95fd9e4-175b-4651-b762-c81cc77fd161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b617ef99-46ba-46c5-a2da-7c5eecb53da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b617ef99-46ba-46c5-a2da-7c5eecb53da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '889e88de-5b03-43d2-b347-46c50fcb8439', 'volume_name': 'volume-889e88de-5b03-43d2-b347-46c50fcb8439', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b191911d-71d5-4016-8739-a913249da2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b191911d-71d5-4016-8739-a913249da2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ea6b45-30ff-4438-8f01-1691e607483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:15 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Volume 889e88de-5b03-43d2-b347-46c50fcb8439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-889e88de-5b03-43d2-b347-46c50fcb8439', 'volume_size': 1} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:15 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c 1073741824" returned: 0 in 0.457s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:15 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c Nov 03 17:06:15 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:15 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c" returned: 0 in 0.244s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.684s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ed2ef3-118d-4142-b78f-fecdcc41c4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6980ea09-3f1e-4466-b919-47bb25e4ed00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Creating offline snapshot f4e54a76-779b-4662-8a37-0f8020b6627c of volume f1a70216-92ee-4f96-8fba-7351a167ef2e {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:06:15 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Volume volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c (c2fd575f-e79a-462e-a4aa-aa35adf3253c): created successfully Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6980ea09-3f1e-4466-b919-47bb25e4ed00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Flow 'volume_create_manager' (da806011-b714-4a7f-99c7-2e543cca715f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0167ae-ef67-4371-ac10-eb2e8fd91a82]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:15 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a924030d-0878-416e-975e-47a7dfa3f2b5 tempest-VolumesTestJSON-28217862 None] Created volume successfully. Nov 03 17:06:15 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e Nov 03 17:06:15 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:15 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e" returned: 0 in 0.384s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:15 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c 1G Nov 03 17:06:15 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Flow 'volume_create_manager' (f0e36a6e-f776-4cce-91c2-24344da3e055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631e986c-2a46-49d9-b6eb-3fdac43f4056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631e986c-2a46-49d9-b6eb-3fdac43f4056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-947490053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d024760-4cab-40ad-af51-6f7a5f35f78a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae20ea47000497fa84ce1f8632479a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:16Z,use_quota=True,user_id='aa87c298d5164fd8a4352a5e829579ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193ed385-2a71-4130-90cc-ca7a4559d088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193ed385-2a71-4130-90cc-ca7a4559d088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05fc196-996f-4880-9bad-cb53d083db89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05fc196-996f-4880-9bad-cb53d083db89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d024760-4cab-40ad-af51-6f7a5f35f78a', 'volume_name': 'volume-3d024760-4cab-40ad-af51-6f7a5f35f78a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e5a514-7568-496c-9e5b-5c66431e8ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e5a514-7568-496c-9e5b-5c66431e8ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af9a2a4-5e13-4bcf-85a0-63a419ebba68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:16 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Volume 3d024760-4cab-40ad-af51-6f7a5f35f78a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d024760-4cab-40ad-af51-6f7a5f35f78a', 'volume_size': 1} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:16 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c 1G" returned: 0 in 0.513s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a70216-92ee-4f96-8fba-7351a167ef2e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:16 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a70216-92ee-4f96-8fba-7351a167ef2e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c Nov 03 17:06:16 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:16 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a70216-92ee-4f96-8fba-7351a167ef2e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c" returned: 0 in 0.285s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:16 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c is being set with open permissions: ugo+rw Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:16 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c Nov 03 17:06:16 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:16 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c" returned: 0 in 0.228s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:16 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.info Nov 03 17:06:16 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:17 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.info" returned: 0 in 0.277s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:17 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.info is being set with open permissions: ugo+rw Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:17 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.info Nov 03 17:06:17 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:17 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.info" returned: 0 in 0.246s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.339s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1604736278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889e88de-5b03-43d2-b347-46c50fcb8439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a5eec9b32c46bcafaf06e3eb3e0cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:15Z,use_quota=True,user_id='e22620ad0f48483f9c903d162612ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Creating volume 889e88de-5b03-43d2-b347-46c50fcb8439 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:17 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:17 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439 1073741824 Nov 03 17:06:17 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:17 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-60ffcaec-3707-4a25-a829-c38658bba3bb tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Create snapshot completed successfully Nov 03 17:06:17 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439 1073741824" returned: 0 in 0.521s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:18 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439 Nov 03 17:06:18 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:18 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439" returned: 0 in 0.268s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-947490053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d024760-4cab-40ad-af51-6f7a5f35f78a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cae20ea47000497fa84ce1f8632479a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:16Z,use_quota=True,user_id='aa87c298d5164fd8a4352a5e829579ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Creating volume 3d024760-4cab-40ad-af51-6f7a5f35f78a {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:18 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ea6b45-30ff-4438-8f01-1691e607483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-889e88de-5b03-43d2-b347-46c50fcb8439', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:18 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a 1073741824 Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d0636e-3680-4e97-b9b6-799466714e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:18 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:18 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Volume volume-889e88de-5b03-43d2-b347-46c50fcb8439 (889e88de-5b03-43d2-b347-46c50fcb8439): created successfully Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d0636e-3680-4e97-b9b6-799466714e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Flow 'volume_create_manager' (ab647bf3-b40a-4526-82af-c001a1c06fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Acquiring lock "cinder-f4e54a76-779b-4662-8a37-0f8020b6627c-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:18 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-78369e8b-40f7-419c-beb3-ea6ff8bc4fbd tempest-VolumeQuotasNegativeTestJSON-799094415 None] Created volume successfully. Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "cinder-f4e54a76-779b-4662-8a37-0f8020b6627c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Acquiring lock "cinder-quobyte-f1a70216-92ee-4f96-8fba-7351a167ef2e" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "cinder-quobyte-f1a70216-92ee-4f96-8fba-7351a167ef2e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Acquiring lock "cinder-quobyte-f4e54a76-779b-4662-8a37-0f8020b6627c" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "cinder-quobyte-f4e54a76-779b-4662-8a37-0f8020b6627c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Deleting offline snapshot f4e54a76-779b-4662-8a37-0f8020b6627c of volume f1a70216-92ee-4f96-8fba-7351a167ef2e {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] snapshot_file for this snap is: volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b43d53-0adb-4864-9c30-c8aeb9b86330]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:18 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c Nov 03 17:06:18 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:18 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a 1073741824" returned: 0 in 0.459s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:18 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a Nov 03 17:06:18 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:18 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c" returned: 0 in 0.414s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a70216-92ee-4f96-8fba-7351a167ef2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d51a14-d193-4434-a2eb-6fce7c007b57]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:19 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e Nov 03 17:06:19 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:19 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a" returned: 0 in 0.280s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af9a2a4-5e13-4bcf-85a0-63a419ebba68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d024760-4cab-40ad-af51-6f7a5f35f78a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c971b6-3d41-40ac-9b2e-44b9fdeacaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:19 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Volume volume-3d024760-4cab-40ad-af51-6f7a5f35f78a (3d024760-4cab-40ad-af51-6f7a5f35f78a): created successfully Nov 03 17:06:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c971b6-3d41-40ac-9b2e-44b9fdeacaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Flow 'volume_create_manager' (f0e36a6e-f776-4cce-91c2-24344da3e055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:19 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-da090b15-dfaf-421e-8747-ebeca4893610 tempest-VolumesTestJSON-28217862 None] Created volume successfully. Nov 03 17:06:19 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e" returned: 0 in 0.463s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:19 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c Nov 03 17:06:19 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:19 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c" returned: 0 in 0.432s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:19 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c Nov 03 17:06:19 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:20 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e.f4e54a76-779b-4662-8a37-0f8020b6627c" returned: 0 in 0.327s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "cinder-quobyte-f4e54a76-779b-4662-8a37-0f8020b6627c" released by "_delete_snapshot" :: held 1.767s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "cinder-quobyte-f1a70216-92ee-4f96-8fba-7351a167ef2e" released by "delete_snapshot" :: held 1.793s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Created reservations ['a6a124b4-5cb0-477c-ac22-43620663250f', '68e24b0c-ec10-4632-8f78-0517982bd794', 'afad9b9c-866c-4178-8c22-4295c778428e', 'e62b1648-61b9-4810-ab94-a3024fe3d58b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:20 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Delete snapshot completed successfully. Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4c161d4-abc4-4320-854a-331402d638dc tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "cinder-f4e54a76-779b-4662-8a37-0f8020b6627c-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Acquiring lock "cinder-3d024760-4cab-40ad-af51-6f7a5f35f78a-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Lock "cinder-3d024760-4cab-40ad-af51-6f7a5f35f78a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Acquiring lock "cinder-quobyte-3d024760-4cab-40ad-af51-6f7a5f35f78a" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Lock "cinder-quobyte-3d024760-4cab-40ad-af51-6f7a5f35f78a" acquired by "delete_volume" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c583bee-6974-43c0-becc-89912c3b6b40]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Acquiring lock "cinder-889e88de-5b03-43d2-b347-46c50fcb8439-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Lock "cinder-889e88de-5b03-43d2-b347-46c50fcb8439-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:20 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a Nov 03 17:06:20 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Acquiring lock "cinder-f1a70216-92ee-4f96-8fba-7351a167ef2e-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Acquiring lock "cinder-quobyte-889e88de-5b03-43d2-b347-46c50fcb8439" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Lock "cinder-quobyte-889e88de-5b03-43d2-b347-46c50fcb8439" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "cinder-f1a70216-92ee-4f96-8fba-7351a167ef2e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[583a333a-7d10-4cc5-add0-095ffb105660]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Acquiring lock "cinder-quobyte-f1a70216-92ee-4f96-8fba-7351a167ef2e" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "cinder-quobyte-f1a70216-92ee-4f96-8fba-7351a167ef2e" acquired by "delete_volume" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4122871-140c-4e32-a3e9-139f5d3c7a05]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:20 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439 Nov 03 17:06:20 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:21 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e Nov 03 17:06:21 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:21 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a" returned: 0 in 0.481s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:21 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a Nov 03 17:06:21 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:21 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439" returned: 0 in 0.408s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:21 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439 Nov 03 17:06:21 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:21 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e" returned: 0 in 0.403s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:21 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e Nov 03 17:06:21 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:21 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d024760-4cab-40ad-af51-6f7a5f35f78a" returned: 0 in 0.292s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Lock "cinder-quobyte-3d024760-4cab-40ad-af51-6f7a5f35f78a" released by "delete_volume" :: held 0.832s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Created reservations ['9832cb4f-1caa-4357-a09b-cf33d7ba4120', '045ac55e-98d5-439b-8edc-a0f81db03be7', '1ca74d52-f1a3-4d88-b856-97538c1ecb6f', '720a6d11-0eed-4cf2-89c5-25df8b9690bc'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:21 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-889e88de-5b03-43d2-b347-46c50fcb8439" returned: 0 in 0.276s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Lock "cinder-quobyte-889e88de-5b03-43d2-b347-46c50fcb8439" released by "delete_volume" :: held 0.760s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:21 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:06:21 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:21 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f1a70216-92ee-4f96-8fba-7351a167ef2e" returned: 0 in 0.283s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Created reservations ['c0ffe1d7-c8ee-4221-ba8c-7912c273c0c1', '840e76ae-92ff-42e9-bf55-85d33f88a8aa', 'fed5cb1c-aaf5-4845-9c25-15f6d0d10b35', '17e0a99d-4e43-48c8-8cad-6197d28d0be8'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "cinder-quobyte-f1a70216-92ee-4f96-8fba-7351a167ef2e" released by "delete_volume" :: held 0.757s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Acquiring lock "cinder-c2fd575f-e79a-462e-a4aa-aa35adf3253c-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Lock "cinder-c2fd575f-e79a-462e-a4aa-aa35adf3253c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Created reservations ['47a4c121-380a-4b1b-9594-03e09ad5da10', '04d1344d-ea5c-475f-95c0-69c8ca08a783', 'd3157c60-2284-47f5-879b-107ac3cc1e31', '53d4e939-fa56-4271-ac4f-73db993e0f73'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Acquiring lock "cinder-quobyte-c2fd575f-e79a-462e-a4aa-aa35adf3253c" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:21 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:06:21 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Lock "cinder-quobyte-c2fd575f-e79a-462e-a4aa-aa35adf3253c" acquired by "delete_volume" :: waited 0.063s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d07d17-5944-46ea-bf84-2ae49eba3d9c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:21 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.401s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:21 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:21 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:06:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Deleted volume successfully. Nov 03 17:06:21 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5fad54aa-0b3c-4bbe-8fc7-202729541087 tempest-VolumesTestJSON-28217862 None] Lock "cinder-3d024760-4cab-40ad-af51-6f7a5f35f78a-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:22 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:22 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.323s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:22 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Deleted volume successfully. Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bae08a9-87e9-43cb-8a98-57efbee17c33 tempest-VolumeQuotasNegativeTestJSON-799094415 None] Lock "cinder-889e88de-5b03-43d2-b347-46c50fcb8439-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:22 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.395s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Deleted volume successfully. Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fc357c04-cfe6-47fa-911d-128f54c78e99 tempest-VolumeSnapshotQuotasNegativeTestJSON-242540173 None] Lock "cinder-f1a70216-92ee-4f96-8fba-7351a167ef2e-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:22 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c" returned: 0 in 0.548s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:22 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c Nov 03 17:06:22 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:22 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c2fd575f-e79a-462e-a4aa-aa35adf3253c" returned: 0 in 0.318s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Lock "cinder-quobyte-c2fd575f-e79a-462e-a4aa-aa35adf3253c" released by "delete_volume" :: held 0.982s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:22 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Created reservations ['4109f86a-d565-4e2f-a906-02571e60a4bc', 'ccf5600c-4706-4535-89ec-28c2ea81221a', '3edda505-8b1a-4d46-92ad-92c338b8b4e8', '19299fd8-7ea5-49bb-9592-813a86ffd3cb'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:23 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:06:23 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:23 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.457s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:23 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:23 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Deleted volume successfully. Nov 03 17:06:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3403f618-3e2c-459c-af6c-e1b827e7bddc tempest-VolumesTestJSON-28217862 None] Lock "cinder-c2fd575f-e79a-462e-a4aa-aa35adf3253c-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Acquiring lock "cinder-b17cf45d-52dd-40a9-bea2-376ee90f6ef3-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Lock "cinder-b17cf45d-52dd-40a9-bea2-376ee90f6ef3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:24 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:INSERT=38,cinder:UPDATE=143,cinder:SELECT=105,cinder:DELETE=9 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:06:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Acquiring lock "cinder-quobyte-b17cf45d-52dd-40a9-bea2-376ee90f6ef3" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Lock "cinder-quobyte-b17cf45d-52dd-40a9-bea2-376ee90f6ef3" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:24 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6e9a83-f96b-4767-951f-b4920392177c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:24 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3 Nov 03 17:06:24 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:24 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3" returned: 0 in 0.456s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:24 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3 Nov 03 17:06:24 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:25 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b17cf45d-52dd-40a9-bea2-376ee90f6ef3" returned: 0 in 0.400s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Lock "cinder-quobyte-b17cf45d-52dd-40a9-bea2-376ee90f6ef3" released by "delete_volume" :: held 0.936s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Created reservations ['e15909ee-159a-48c2-a0fe-c1de9c8f3760', 'b003e96b-e960-4a4e-a289-678b4a80f53b', '8fa1ea86-943a-4a06-906f-00c748fe5327', '4e7767cd-1404-4f7a-9785-f77fe6e6bd11'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:25 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:06:25 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:25 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.407s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Deleted volume successfully. Nov 03 17:06:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4bf08a1-ec22-4906-9112-08ccc8e136f6 tempest-VolumesTestJSON-28217862 None] Lock "cinder-b17cf45d-52dd-40a9-bea2-376ee90f6ef3-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:29 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-b406926f-e52b-4195-80d5-83e6deacd3fa req-ad29694f-5a9b-48a6-b3fd-8b056439e120 tempest-AttachVolumeNegativeTest-1504269075 None] Terminate volume connection completed successfully. Nov 03 17:06:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-b406926f-e52b-4195-80d5-83e6deacd3fa req-ad29694f-5a9b-48a6-b3fd-8b056439e120 tempest-AttachVolumeNegativeTest-1504269075 None] Deleting attachment 2e97fe49-bd91-4073-b734-5ae7610fd8f3. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:06:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:06:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:29 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:06:29 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:30 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.306s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:06:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:06:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=112,cinder:INSERT=31,cinder:UPDATE=140,cinder:DELETE=11 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Flow 'volume_create_manager' (14e47e2f-01f2-4b63-b010-1461c449ec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ded244-fee5-4686-ab5c-16e452ecc9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ded244-fee5-4686-ab5c-16e452ecc9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1843792216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddeea10-cb90-4991-8b2d-710d7e0b4e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e10cc42b2b49629c2ac1f4ca0f1699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:33Z,use_quota=True,user_id='a3e9f08d1de945e081a2b159dab1780e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cd83925-9a14-4c03-aff4-5323939ce555),volume_type_id=9cd83925-9a14-4c03-aff4-5323939ce555)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72d86bd-45db-4acb-a722-aae979b48e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72d86bd-45db-4acb-a722-aae979b48e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a16b688-0119-49d6-a6bc-aba09895d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a16b688-0119-49d6-a6bc-aba09895d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bddeea10-cb90-4991-8b2d-710d7e0b4e8e', 'volume_name': 'volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ee80d9-82c6-4e1a-a3c6-08e5e31f0945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ee80d9-82c6-4e1a-a3c6-08e5e31f0945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610d91ae-b896-4ef4-a26b-0941fcd15924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:33 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Volume bddeea10-cb90-4991-8b2d-710d7e0b4e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e', 'volume_size': 1} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1843792216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddeea10-cb90-4991-8b2d-710d7e0b4e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e10cc42b2b49629c2ac1f4ca0f1699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:33Z,use_quota=True,user_id='a3e9f08d1de945e081a2b159dab1780e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cd83925-9a14-4c03-aff4-5323939ce555),volume_type_id=9cd83925-9a14-4c03-aff4-5323939ce555)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Creating volume bddeea10-cb90-4991-8b2d-710d7e0b4e8e {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:33 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:06:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:33 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e 1073741824 Nov 03 17:06:33 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:34 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e 1073741824" returned: 0 in 0.596s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:34 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e Nov 03 17:06:34 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:34 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e" returned: 0 in 0.290s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610d91ae-b896-4ef4-a26b-0941fcd15924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9950f2ef-a998-4b7e-9045-028716b70ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:34 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Volume volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e (bddeea10-cb90-4991-8b2d-710d7e0b4e8e): created successfully Nov 03 17:06:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9950f2ef-a998-4b7e-9045-028716b70ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Flow 'volume_create_manager' (14e47e2f-01f2-4b63-b010-1461c449ec8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:34 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-85111e7b-129d-476d-94e4-da1839d54b3f tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Created volume successfully. Nov 03 17:06:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1cf6f8de-74b9-41d6-ac9d-87cb0415c8b2 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1cf6f8de-74b9-41d6-ac9d-87cb0415c8b2 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6f8de-74b9-41d6-ac9d-87cb0415c8b2 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1cf6f8de-74b9-41d6-ac9d-87cb0415c8b2 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1cf6f8de-74b9-41d6-ac9d-87cb0415c8b2 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1cf6f8de-74b9-41d6-ac9d-87cb0415c8b2 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:36 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:06:36 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:36 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1cf6f8de-74b9-41d6-ac9d-87cb0415c8b2 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.300s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:36 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-1cf6f8de-74b9-41d6-ac9d-87cb0415c8b2 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1cf6f8de-74b9-41d6-ac9d-87cb0415c8b2 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Retype volume completed successfully. Nov 03 17:06:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Acquiring lock "cinder-bddeea10-cb90-4991-8b2d-710d7e0b4e8e-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "cinder-bddeea10-cb90-4991-8b2d-710d7e0b4e8e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Acquiring lock "cinder-quobyte-bddeea10-cb90-4991-8b2d-710d7e0b4e8e" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "cinder-quobyte-bddeea10-cb90-4991-8b2d-710d7e0b4e8e" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:37 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c53cb7-7c40-442a-9961-c731ad84d703]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:37 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e Nov 03 17:06:37 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:38 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e" returned: 0 in 0.504s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:38 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e Nov 03 17:06:38 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:38 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bddeea10-cb90-4991-8b2d-710d7e0b4e8e" returned: 0 in 0.393s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "cinder-quobyte-bddeea10-cb90-4991-8b2d-710d7e0b4e8e" released by "delete_volume" :: held 0.959s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:38 devstack cinder-volume[86661]: WARNING cinder.quota [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:06:38 devstack cinder-volume[86661]: WARNING cinder.quota [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:06:38 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Created reservations ['cbbc5627-ea67-4e26-8ce2-975af288217e', '986f6eec-22c6-4653-94e6-dd160a8989c1', 'bd14f678-a9f7-46d3-9218-db2ffa53aca2', '8bde3d43-e5e5-4c5b-8884-c5f6f2f79fc3'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:38 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:06:38 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:39 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.385s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:39 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:39 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Deleted volume successfully. Nov 03 17:06:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b4531d11-8375-4e1a-b999-84ed705f2a82 tempest-VolumeRetypeWithoutMigrationTest-1470933732 None] Lock "cinder-bddeea10-cb90-4991-8b2d-710d7e0b4e8e-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:48 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:06:49 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=22,cinder:INSERT=3,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Flow 'volume_create_manager' (630b515f-3e5e-4065-8e0d-5f48c37cf5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48135837-a3df-4b7f-a81b-e7b811646484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48135837-a3df-4b7f-a81b-e7b811646484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2093385735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6585005-59f0-442b-89a8-82467aa135bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395345f3eea8427dad9b0ed36c45bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:55Z,use_quota=True,user_id='4a27bc0951b147ffa4a5d6d54ab93352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68892cad-874e-4aa5-8e95-b09017e8f186),volume_type_id=68892cad-874e-4aa5-8e95-b09017e8f186)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce583f-44c0-4630-b754-8a1fffab1de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce583f-44c0-4630-b754-8a1fffab1de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d2f91a-4e49-4382-a1aa-8400e0d1d620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d2f91a-4e49-4382-a1aa-8400e0d1d620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6585005-59f0-442b-89a8-82467aa135bb', 'volume_name': 'volume-d6585005-59f0-442b-89a8-82467aa135bb', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa487b64-8aae-4253-af36-2bf91636694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa487b64-8aae-4253-af36-2bf91636694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47de467-a135-4f6a-9cd7-d10b3d2af77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Volume d6585005-59f0-442b-89a8-82467aa135bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6585005-59f0-442b-89a8-82467aa135bb', 'volume_size': 1} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2093385735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6585005-59f0-442b-89a8-82467aa135bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395345f3eea8427dad9b0ed36c45bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:55Z,use_quota=True,user_id='4a27bc0951b147ffa4a5d6d54ab93352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68892cad-874e-4aa5-8e95-b09017e8f186),volume_type_id=68892cad-874e-4aa5-8e95-b09017e8f186)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Creating volume d6585005-59f0-442b-89a8-82467aa135bb {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:55 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:55 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb 1073741824 Nov 03 17:06:55 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Flow 'volume_create_manager' (1c902b81-a78c-4eca-9dec-ed2b72eb43a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3900327-5d88-4759-a1bd-80c205224530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3900327-5d88-4759-a1bd-80c205224530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-807200940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1aefa02-c9f7-411c-9463-1a44a32aedd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c465d9e5e954479480082d4640476ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:55Z,use_quota=True,user_id='89eafcd45c3d4b1e919db3bbc136aeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b024519-8754-41da-bcff-27cd336b52ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b024519-8754-41da-bcff-27cd336b52ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896004bb-3f74-48a4-8360-d3132664e9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896004bb-3f74-48a4-8360-d3132664e9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1aefa02-c9f7-411c-9463-1a44a32aedd9', 'volume_name': 'volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e581d83-2149-4411-9359-a59fda8208b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e581d83-2149-4411-9359-a59fda8208b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e43f3b8-ea62-46a9-8234-ca1302da94c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:55 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Volume a1aefa02-c9f7-411c-9463-1a44a32aedd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9', 'volume_size': 1} Nov 03 17:06:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:56 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb 1073741824" returned: 0 in 0.808s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:56 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb Nov 03 17:06:56 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:56 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb" returned: 0 in 0.317s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.021s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-807200940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1aefa02-c9f7-411c-9463-1a44a32aedd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c465d9e5e954479480082d4640476ade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:06:55Z,use_quota=True,user_id='89eafcd45c3d4b1e919db3bbc136aeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Creating volume a1aefa02-c9f7-411c-9463-1a44a32aedd9 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:06:56 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47de467-a135-4f6a-9cd7-d10b3d2af77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6585005-59f0-442b-89a8-82467aa135bb', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:56 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9 1073741824 Nov 03 17:06:56 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de091a82-729c-41a7-a7a4-50160fbb45ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:56 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Volume volume-d6585005-59f0-442b-89a8-82467aa135bb (d6585005-59f0-442b-89a8-82467aa135bb): created successfully Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de091a82-729c-41a7-a7a4-50160fbb45ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Flow 'volume_create_manager' (630b515f-3e5e-4065-8e0d-5f48c37cf5f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:56 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-51cc9a90-07f8-4a59-acaf-710f9a6b0179 tempest-VolumeTypesAccessTest-271730886 None] Created volume successfully. Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Acquiring lock "cinder-d6585005-59f0-442b-89a8-82467aa135bb-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Lock "cinder-d6585005-59f0-442b-89a8-82467aa135bb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Acquiring lock "cinder-quobyte-d6585005-59f0-442b-89a8-82467aa135bb" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Lock "cinder-quobyte-d6585005-59f0-442b-89a8-82467aa135bb" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d476fe-3ffb-44d9-a2f2-3843ecb55128]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:57 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9 1073741824" returned: 0 in 0.817s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:57 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb Nov 03 17:06:57 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:57 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9 Nov 03 17:06:57 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:57 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9" returned: 0 in 0.342s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e43f3b8-ea62-46a9-8234-ca1302da94c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c035c06f-78cf-44bd-9948-b108a07ca2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:06:57 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Volume volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9 (a1aefa02-c9f7-411c-9463-1a44a32aedd9): created successfully Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c035c06f-78cf-44bd-9948-b108a07ca2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Flow 'volume_create_manager' (1c902b81-a78c-4eca-9dec-ed2b72eb43a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:06:57 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-21775b59-51c9-42db-8018-6d1bcd1be261 tempest-VolumesServicesTestJSON-476790885 None] Created volume successfully. Nov 03 17:06:57 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb" returned: 0 in 0.700s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:57 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb Nov 03 17:06:57 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:58 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6585005-59f0-442b-89a8-82467aa135bb" returned: 0 in 0.347s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Lock "cinder-quobyte-d6585005-59f0-442b-89a8-82467aa135bb" released by "delete_volume" :: held 1.102s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:58 devstack cinder-volume[86661]: WARNING cinder.quota [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-102147945 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-102147945, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:06:58 devstack cinder-volume[86661]: WARNING cinder.quota [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-102147945 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-102147945, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Created reservations ['8b5dbd92-7a48-4e96-b316-8e95eb09b0d1', '6d9543c3-f903-4416-a40b-63ceee6c7eb3', '9b379631-d260-4072-9e1a-7704881e5a1a', 'd7e5ec93-7ba2-47b4-9dfa-077947a4bf59'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:58 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:06:58 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Acquiring lock "cinder-a1aefa02-c9f7-411c-9463-1a44a32aedd9-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Lock "cinder-a1aefa02-c9f7-411c-9463-1a44a32aedd9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:58 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.388s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Acquiring lock "cinder-quobyte-a1aefa02-c9f7-411c-9463-1a44a32aedd9" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:06:58 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Deleted volume successfully. Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Lock "cinder-quobyte-a1aefa02-c9f7-411c-9463-1a44a32aedd9" acquired by "delete_volume" :: waited 0.038s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ee2f69aa-584c-46a1-bdef-d62a819880cc tempest-VolumeTypesAccessTest-271730886 None] Lock "cinder-d6585005-59f0-442b-89a8-82467aa135bb-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eb5320-6139-4de0-9195-5dc541fea403]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:06:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:59 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9 Nov 03 17:06:59 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:59 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9" returned: 0 in 0.526s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:06:59 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9 Nov 03 17:06:59 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:06:59 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Nov 03 17:06:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a1aefa02-c9f7-411c-9463-1a44a32aedd9" returned: 0 in 0.481s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:06:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Lock "cinder-quobyte-a1aefa02-c9f7-411c-9463-1a44a32aedd9" released by "delete_volume" :: held 1.085s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:00 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Created reservations ['525a5280-a44a-4e35-8ce3-a4614d6dfc05', 'e3f5cb4c-5fb8-429f-9548-963c118db0a1', '1d0cb7e9-3536-4341-832b-98a208fa2337', '91a44783-04cb-4b07-a536-faf5829e6af7'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:00 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:07:00 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:00 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.330s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:00 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:00 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Deleted volume successfully. Nov 03 17:07:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dd7cd81c-fa9f-412a-b335-335fff93c2c6 tempest-VolumesServicesTestJSON-476790885 None] Lock "cinder-a1aefa02-c9f7-411c-9463-1a44a32aedd9-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:10 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=27,cinder:SELECT=14,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:07:10 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Flow 'volume_create_manager' (4bbfc9f2-27d8-4c08-8e97-1909eb5f90f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaeca470-6054-4cf0-9c7b-8c0a416d9378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaeca470-6054-4cf0-9c7b-8c0a416d9378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1484316808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46512db0-0b29-4cf4-aeb9-bc68044d2992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b133de72c74fda91907fe808bd5f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:14Z,use_quota=True,user_id='f7569865282447f19ecbbb55f7b64094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faed8751-6938-4330-9564-6bd249df2d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faed8751-6938-4330-9564-6bd249df2d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a9f3d6-b3ff-4d57-8518-0a1b4b42a82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a9f3d6-b3ff-4d57-8518-0a1b4b42a82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46512db0-0b29-4cf4-aeb9-bc68044d2992', 'volume_name': 'volume-46512db0-0b29-4cf4-aeb9-bc68044d2992', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3eab6dc-2112-4b5e-994f-76e1d0f4cd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3eab6dc-2112-4b5e-994f-76e1d0f4cd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3238c1-0ffb-4bbf-b26d-6ccfd1eb2a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:14 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Volume 46512db0-0b29-4cf4-aeb9-bc68044d2992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46512db0-0b29-4cf4-aeb9-bc68044d2992', 'volume_size': 1} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1484316808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46512db0-0b29-4cf4-aeb9-bc68044d2992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b133de72c74fda91907fe808bd5f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:14Z,use_quota=True,user_id='f7569865282447f19ecbbb55f7b64094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Creating volume 46512db0-0b29-4cf4-aeb9-bc68044d2992 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:14 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:14 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992 1073741824 Nov 03 17:07:14 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:15 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992 1073741824" returned: 0 in 0.739s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:15 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992 Nov 03 17:07:15 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:15 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992" returned: 0 in 0.463s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3238c1-0ffb-4bbf-b26d-6ccfd1eb2a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46512db0-0b29-4cf4-aeb9-bc68044d2992', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bef226-c99b-4a47-8059-486c65da914f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:16 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Volume volume-46512db0-0b29-4cf4-aeb9-bc68044d2992 (46512db0-0b29-4cf4-aeb9-bc68044d2992): created successfully Nov 03 17:07:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bef226-c99b-4a47-8059-486c65da914f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Flow 'volume_create_manager' (4bbfc9f2-27d8-4c08-8e97-1909eb5f90f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:16 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-78e10b96-49da-4cf5-a68a-bd16ab242e72 tempest-AttachVolumeNegativeTest-1504269075 None] Created volume successfully. Nov 03 17:07:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-4eea7f04-fea3-46c7-acf5-9e7b2e605d73 req-2daae44c-0532-481d-94e5-38db0f45a49d tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-4eea7f04-fea3-46c7-acf5-9e7b2e605d73 req-2daae44c-0532-481d-94e5-38db0f45a49d tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-4eea7f04-fea3-46c7-acf5-9e7b2e605d73 req-2daae44c-0532-481d-94e5-38db0f45a49d tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-4eea7f04-fea3-46c7-acf5-9e7b2e605d73 req-2daae44c-0532-481d-94e5-38db0f45a49d tempest-AttachVolumeNegativeTest-1504269075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-46512db0-0b29-4cf4-aeb9-bc68044d2992', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b04186e-4993-4c48-812f-a9197fb2b824', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:07:17 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-4eea7f04-fea3-46c7-acf5-9e7b2e605d73 req-2daae44c-0532-481d-94e5-38db0f45a49d tempest-AttachVolumeNegativeTest-1504269075 None] attachment_update completed successfully. Nov 03 17:07:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-d3fc020f-a08a-493e-94e7-7cc4f46fd16a req-bde53bb3-fa59-4cc7-9dd6-fa96f804095a tempest-AttachVolumeNegativeTest-1504269075 None] Terminate volume connection completed successfully. Nov 03 17:07:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-d3fc020f-a08a-493e-94e7-7cc4f46fd16a req-bde53bb3-fa59-4cc7-9dd6-fa96f804095a tempest-AttachVolumeNegativeTest-1504269075 None] Deleting attachment 6b04186e-4993-4c48-812f-a9197fb2b824. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (a97bca81-d0bb-44f2-86e9-abdc6b4a639c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ac5483-229c-4522-bc51-ef98fc56ba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ac5483-229c-4522-bc51-ef98fc56ba62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1947040397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4900fc-c5bd-4290-8c3c-b7dd483382e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:24Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8902e9a4-7a50-46fc-9e90-d7ddc204cbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8902e9a4-7a50-46fc-9e90-d7ddc204cbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd91b7c9-5c58-44c6-b4ba-a943bf29bf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd91b7c9-5c58-44c6-b4ba-a943bf29bf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4900fc-c5bd-4290-8c3c-b7dd483382e7', 'volume_name': 'volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc40f38-b2b3-4c81-9bba-8d8a05b63366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc40f38-b2b3-4c81-9bba-8d8a05b63366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ea12c3-09b7-4e57-a1c8-e3fd65119fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:23 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Volume ce4900fc-c5bd-4290-8c3c-b7dd483382e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7', 'volume_size': 1} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1947040397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4900fc-c5bd-4290-8c3c-b7dd483382e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:24Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Creating volume ce4900fc-c5bd-4290-8c3c-b7dd483382e7 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:23 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:23 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7 1073741824 Nov 03 17:07:23 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:24 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7 1073741824" returned: 0 in 0.988s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:24 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7 Nov 03 17:07:24 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:25 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7" returned: 0 in 0.312s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ea12c3-09b7-4e57-a1c8-e3fd65119fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25b29ce-1855-47dd-a051-15af3d94e73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:25 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Volume volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7 (ce4900fc-c5bd-4290-8c3c-b7dd483382e7): created successfully Nov 03 17:07:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25b29ce-1855-47dd-a051-15af3d94e73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (a97bca81-d0bb-44f2-86e9-abdc6b4a639c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-872aafc7-8de3-409a-8a25-1323e5d3ff3c tempest-VolumesActionsTest-1449331550 None] Created volume successfully. Nov 03 17:07:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3f1cbe42-3602-47af-b683-3bf50d373c90 tempest-VolumesActionsTest-1449331550 None] Acquiring lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7" by "attach_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3f1cbe42-3602-47af-b683-3bf50d373c90 tempest-VolumesActionsTest-1449331550 None] Lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7" acquired by "attach_volume" :: waited 0.049s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3f1cbe42-3602-47af-b683-3bf50d373c90 tempest-VolumesActionsTest-1449331550 None] Attaching volume ce4900fc-c5bd-4290-8c3c-b7dd483382e7 to instance e39ac935-66e0-4445-b418-7ccb66a0739b at mountpoint /dev/vdb on host None. Nov 03 17:07:26 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3f1cbe42-3602-47af-b683-3bf50d373c90 tempest-VolumesActionsTest-1449331550 None] Attach volume completed successfully. Nov 03 17:07:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3f1cbe42-3602-47af-b683-3bf50d373c90 tempest-VolumesActionsTest-1449331550 None] Lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7" released by "attach_volume" :: held 0.276s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-25e93bc0-ca5c-4bd2-bbaf-06c7728c5c64 tempest-VolumesActionsTest-646984728 None] Terminate volume connection completed successfully. Nov 03 17:07:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-25e93bc0-ca5c-4bd2-bbaf-06c7728c5c64 tempest-VolumesActionsTest-646984728 None] Acquiring lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7-detach_volume" by "detach_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-25e93bc0-ca5c-4bd2-bbaf-06c7728c5c64 tempest-VolumesActionsTest-646984728 None] Lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-25e93bc0-ca5c-4bd2-bbaf-06c7728c5c64 tempest-VolumesActionsTest-646984728 None] Detaching volume ce4900fc-c5bd-4290-8c3c-b7dd483382e7 from instance e39ac935-66e0-4445-b418-7ccb66a0739b. Nov 03 17:07:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-25e93bc0-ca5c-4bd2-bbaf-06c7728c5c64 tempest-VolumesActionsTest-646984728 None] Detach volume completed successfully. Nov 03 17:07:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-25e93bc0-ca5c-4bd2-bbaf-06c7728c5c64 tempest-VolumesActionsTest-646984728 None] Lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8a44723a-2042-4ce9-b703-d1a9be66746b tempest-VolumesActionsTest-1449331550 None] Acquiring lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7-detach_volume" by "detach_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8a44723a-2042-4ce9-b703-d1a9be66746b tempest-VolumesActionsTest-1449331550 None] Lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8a44723a-2042-4ce9-b703-d1a9be66746b tempest-VolumesActionsTest-1449331550 None] Volume detach called, but volume not attached. Nov 03 17:07:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8a44723a-2042-4ce9-b703-d1a9be66746b tempest-VolumesActionsTest-1449331550 None] Lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Acquiring lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Acquiring lock "cinder-quobyte-ce4900fc-c5bd-4290-8c3c-b7dd483382e7" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Lock "cinder-quobyte-ce4900fc-c5bd-4290-8c3c-b7dd483382e7" acquired by "delete_volume" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:28 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a04a808-a821-4fdf-8cf1-7fa10b90d211]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:28 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7 Nov 03 17:07:28 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:29 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7" returned: 0 in 0.979s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:29 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7 Nov 03 17:07:29 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:07:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:29 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:07:29 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:30 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ce4900fc-c5bd-4290-8c3c-b7dd483382e7" returned: 0 in 0.452s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Lock "cinder-quobyte-ce4900fc-c5bd-4290-8c3c-b7dd483382e7" released by "delete_volume" :: held 1.530s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Created reservations ['56af9913-b9d7-476f-ad3f-6c799c10b8ff', '426e3db8-edd5-4bd8-b484-38dd0f51cf94', '248ef5f0-b345-4967-83d7-97d15faa1da8', 'bb1eb0f3-8dda-4a33-824f-c402813e1006'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:30 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.483s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:30 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:07:30 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:31 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.713s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:31 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:31 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Deleted volume successfully. Nov 03 17:07:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6b2ab0f3-1e3e-47dc-82b8-e57b4dc32eda tempest-VolumesActionsTest-1449331550 None] Lock "cinder-ce4900fc-c5bd-4290-8c3c-b7dd483382e7-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Flow 'volume_create_manager' (327070a8-2d95-4c05-88a7-656edba34630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb875c7-8844-4f6e-a7a9-9fa17e484ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb875c7-8844-4f6e-a7a9-9fa17e484ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-923736402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac93c030-c698-4cb6-b4c3-fbfe608c03cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992a7a9711a24b66b90e4dc4d4012149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:33Z,use_quota=True,user_id='6c527ed606fd45a58f9b267c8831ef6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e37f693-030b-4592-9eff-a98969af94f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e37f693-030b-4592-9eff-a98969af94f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e54cc51-a7b2-423b-9214-e8dc338ca6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e54cc51-a7b2-423b-9214-e8dc338ca6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac93c030-c698-4cb6-b4c3-fbfe608c03cf', 'volume_name': 'volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33286d36-52d8-4a74-8832-f0a2da41d43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33286d36-52d8-4a74-8832-f0a2da41d43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622fac60-423b-4874-9e0c-a6caf2a2a55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:33 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Volume ac93c030-c698-4cb6-b4c3-fbfe608c03cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf', 'volume_size': 1} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-923736402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac93c030-c698-4cb6-b4c3-fbfe608c03cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992a7a9711a24b66b90e4dc4d4012149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:33Z,use_quota=True,user_id='6c527ed606fd45a58f9b267c8831ef6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Creating volume ac93c030-c698-4cb6-b4c3-fbfe608c03cf {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:33 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:33 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf 1073741824 Nov 03 17:07:33 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:34 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf 1073741824" returned: 0 in 0.716s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:34 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf Nov 03 17:07:34 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:34 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf" returned: 0 in 0.385s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622fac60-423b-4874-9e0c-a6caf2a2a55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5483496-f535-41d2-8444-c13c51c66b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:34 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Volume volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf (ac93c030-c698-4cb6-b4c3-fbfe608c03cf): created successfully Nov 03 17:07:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5483496-f535-41d2-8444-c13c51c66b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Flow 'volume_create_manager' (327070a8-2d95-4c05-88a7-656edba34630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:34 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-42efb9e7-e2c4-4251-9c60-3ea191ba0e70 tempest-VolumesMetadataTest-1351001904 None] Created volume successfully. Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (69646d71-5804-438c-9728-80d00409e7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed1a01a-89c5-4715-9b08-3df16ae2cf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed1a01a-89c5-4715-9b08-3df16ae2cf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1300919452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0592306e-f062-4291-9fb8-ada2046b301f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:36Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669df195-ad6b-4ffc-8ae2-eb5d52b714ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669df195-ad6b-4ffc-8ae2-eb5d52b714ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a08734-e68c-448f-a536-d9272054e955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a08734-e68c-448f-a536-d9272054e955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0592306e-f062-4291-9fb8-ada2046b301f', 'volume_name': 'volume-0592306e-f062-4291-9fb8-ada2046b301f', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ca3446-138f-46eb-8a48-933d98815739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ca3446-138f-46eb-8a48-933d98815739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab39c97-a6fa-4a0f-b7e9-3b7953fefe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:36 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Volume 0592306e-f062-4291-9fb8-ada2046b301f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0592306e-f062-4291-9fb8-ada2046b301f', 'volume_size': 1} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1300919452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0592306e-f062-4291-9fb8-ada2046b301f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:36Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Creating volume 0592306e-f062-4291-9fb8-ada2046b301f {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:36 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:36 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f 1073741824 Nov 03 17:07:36 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:36 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f 1073741824" returned: 0 in 0.690s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:36 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f Nov 03 17:07:36 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:37 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Acquiring lock "cinder-ac93c030-c698-4cb6-b4c3-fbfe608c03cf-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f" returned: 0 in 0.443s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Lock "cinder-ac93c030-c698-4cb6-b4c3-fbfe608c03cf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab39c97-a6fa-4a0f-b7e9-3b7953fefe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0592306e-f062-4291-9fb8-ada2046b301f', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb61b36-31b6-4f58-b2b9-07502582685c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:37 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Volume volume-0592306e-f062-4291-9fb8-ada2046b301f (0592306e-f062-4291-9fb8-ada2046b301f): created successfully Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb61b36-31b6-4f58-b2b9-07502582685c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (69646d71-5804-438c-9728-80d00409e7a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:37 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-fedce7bc-0908-4301-9a55-9ce0f6a93763 tempest-VolumesActionsTest-1449331550 None] Created volume successfully. Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Acquiring lock "cinder-quobyte-ac93c030-c698-4cb6-b4c3-fbfe608c03cf" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Lock "cinder-quobyte-ac93c030-c698-4cb6-b4c3-fbfe608c03cf" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf8dbe5-fe7c-4d16-8e34-ae0e18c515e6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:37 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf Nov 03 17:07:37 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:38 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf" returned: 0 in 0.485s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:38 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf Nov 03 17:07:38 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:38 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ac93c030-c698-4cb6-b4c3-fbfe608c03cf" returned: 0 in 0.277s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Lock "cinder-quobyte-ac93c030-c698-4cb6-b4c3-fbfe608c03cf" released by "delete_volume" :: held 0.820s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Acquiring lock "cinder-0592306e-f062-4291-9fb8-ada2046b301f-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Lock "cinder-0592306e-f062-4291-9fb8-ada2046b301f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Acquiring lock "cinder-quobyte-0592306e-f062-4291-9fb8-ada2046b301f" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Created reservations ['805d1814-9662-483c-a378-020b37ecbbc4', 'bafd8968-71d7-413c-b160-f46f1a5a2592', 'c1a44746-be60-4f5d-ac46-7f0565797fb1', '619696a5-4670-40e1-914d-f2b8bb780a26'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Lock "cinder-quobyte-0592306e-f062-4291-9fb8-ada2046b301f" acquired by "delete_volume" :: waited 0.034s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c845075-7119-4331-b0bc-4a8b094a7da8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:38 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f Nov 03 17:07:38 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:38 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:07:38 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:38 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.312s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:39 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Deleted volume successfully. Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e628395b-fde4-47d7-80fc-015193cdf0d1 tempest-VolumesMetadataTest-1351001904 None] Lock "cinder-ac93c030-c698-4cb6-b4c3-fbfe608c03cf-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:39 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f" returned: 0 in 0.489s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:39 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f Nov 03 17:07:39 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:39 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0592306e-f062-4291-9fb8-ada2046b301f" returned: 0 in 0.343s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Lock "cinder-quobyte-0592306e-f062-4291-9fb8-ada2046b301f" released by "delete_volume" :: held 0.938s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Created reservations ['f047d513-e909-4517-840b-3c9b6a707dd4', '3eab9767-d53b-467b-8645-3da0e0bf3213', '3ada087e-07d1-436c-b25e-fa06be99bf9f', '6bf9a744-6003-4f27-bee7-ab0e1b313017'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:39 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:07:39 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:39 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.371s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:40 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:40 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Deleted volume successfully. Nov 03 17:07:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a97a786a-51f8-4fec-b7b9-1031c81ae338 tempest-VolumesActionsTest-646984728 None] Lock "cinder-0592306e-f062-4291-9fb8-ada2046b301f-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (b43d5a3e-a28d-4c56-84c8-d07d5e339618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e1df2f-3d2f-4edf-8d31-3951d2112a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e1df2f-3d2f-4edf-8d31-3951d2112a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1198335689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57875e7-0bc1-4eec-a82f-624478d29c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:42Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81157e34-cd2d-41a1-ad2f-a4c23d6aaabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81157e34-cd2d-41a1-ad2f-a4c23d6aaabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6c7922-3d1d-4a2d-b6c9-dd360b52c56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6c7922-3d1d-4a2d-b6c9-dd360b52c56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57875e7-0bc1-4eec-a82f-624478d29c91', 'volume_name': 'volume-b57875e7-0bc1-4eec-a82f-624478d29c91', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000e468c-3cd9-431c-a825-3ec7a8232a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000e468c-3cd9-431c-a825-3ec7a8232a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dc9cdf-9139-483c-ac9d-86a51f8cfae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:41 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Volume b57875e7-0bc1-4eec-a82f-624478d29c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57875e7-0bc1-4eec-a82f-624478d29c91', 'volume_size': 1} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1198335689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57875e7-0bc1-4eec-a82f-624478d29c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:42Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Creating volume b57875e7-0bc1-4eec-a82f-624478d29c91 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:41 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:41 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91 1073741824 Nov 03 17:07:41 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:42 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91 1073741824" returned: 0 in 0.922s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:42 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91 Nov 03 17:07:42 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:43 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91" returned: 0 in 0.429s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dc9cdf-9139-483c-ac9d-86a51f8cfae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57875e7-0bc1-4eec-a82f-624478d29c91', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c53352-29ab-4845-adb8-2b41ac4ef04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:43 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Volume volume-b57875e7-0bc1-4eec-a82f-624478d29c91 (b57875e7-0bc1-4eec-a82f-624478d29c91): created successfully Nov 03 17:07:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c53352-29ab-4845-adb8-2b41ac4ef04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (b43d5a3e-a28d-4c56-84c8-d07d5e339618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:43 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-94d466c8-8375-4772-99fc-fe6b86cf6f8d tempest-VolumesActionsTest-1449331550 None] Created volume successfully. Nov 03 17:07:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Acquiring lock "cinder-b57875e7-0bc1-4eec-a82f-624478d29c91-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Lock "cinder-b57875e7-0bc1-4eec-a82f-624478d29c91-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Acquiring lock "cinder-quobyte-b57875e7-0bc1-4eec-a82f-624478d29c91" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Lock "cinder-quobyte-b57875e7-0bc1-4eec-a82f-624478d29c91" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:44 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8d6d45-0fa8-4c36-a182-eb8bc8618186]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:44 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91 Nov 03 17:07:44 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:45 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91" returned: 0 in 0.571s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:45 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91 Nov 03 17:07:45 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:45 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b57875e7-0bc1-4eec-a82f-624478d29c91" returned: 0 in 0.427s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Lock "cinder-quobyte-b57875e7-0bc1-4eec-a82f-624478d29c91" released by "delete_volume" :: held 1.086s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:45 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Created reservations ['1ea80a68-a5de-4ade-affe-4ac90afaa6a1', '2fcc8217-2876-4a72-b2a8-82c671138255', 'f46da2fd-9294-4b1c-a64b-73bc5cded156', '61b197de-7ba9-4fc0-b5c5-c69eabaeadf6'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:45 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:07:45 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:46 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.430s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:46 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:46 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Deleted volume successfully. Nov 03 17:07:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-443ad3e2-6fff-4f6b-b47e-291405953ce5 tempest-VolumesActionsTest-646984728 None] Lock "cinder-b57875e7-0bc1-4eec-a82f-624478d29c91-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (e44ae590-6cfa-4b54-bc10-a09383e2d1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8deca625-4117-4f3a-b144-11ca58b4d944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8deca625-4117-4f3a-b144-11ca58b4d944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1211205466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39250a06-81c5-4920-8881-aa1e4782fd02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:48Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf3afe3-ad92-4662-87aa-e2aa65588222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf3afe3-ad92-4662-87aa-e2aa65588222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5b993c-354c-454f-a827-0374bc7652f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5b993c-354c-454f-a827-0374bc7652f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39250a06-81c5-4920-8881-aa1e4782fd02', 'volume_name': 'volume-39250a06-81c5-4920-8881-aa1e4782fd02', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561723da-ccef-4c85-8536-0c2d8160cfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561723da-ccef-4c85-8536-0c2d8160cfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9208915-9288-4721-a886-09a16e63ec27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:47 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Volume 39250a06-81c5-4920-8881-aa1e4782fd02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39250a06-81c5-4920-8881-aa1e4782fd02', 'volume_size': 1} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1211205466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39250a06-81c5-4920-8881-aa1e4782fd02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:48Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Creating volume 39250a06-81c5-4920-8881-aa1e4782fd02 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:47 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:48 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02 1073741824 Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:48 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (ba524b02-03e6-4c3e-a69d-a44bbcbea103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0781ca68-103c-45cb-be48-eb6a3369a259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0781ca68-103c-45cb-be48-eb6a3369a259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-590437562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fcef25-40a0-4f04-8dda-4b7720b6fc8a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:48Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb979456-8f22-44f4-93f8-9de9bb56f17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb979456-8f22-44f4-93f8-9de9bb56f17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95351ce7-3afe-4a1d-b1e6-ec5b4168d53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95351ce7-3afe-4a1d-b1e6-ec5b4168d53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1fcef25-40a0-4f04-8dda-4b7720b6fc8a', 'volume_name': 'volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa5fdb1-91cb-4f09-ae12-77cb76d82c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa5fdb1-91cb-4f09-ae12-77cb76d82c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de18487-6cb8-4e7f-81b4-2d066e0b15c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:48 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Volume c1fcef25-40a0-4f04-8dda-4b7720b6fc8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a', 'volume_size': 1} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:48 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02 1073741824" returned: 0 in 0.574s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:48 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02 Nov 03 17:07:48 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:48 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02" returned: 0 in 0.287s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.728s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-590437562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fcef25-40a0-4f04-8dda-4b7720b6fc8a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:48Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Creating volume c1fcef25-40a0-4f04-8dda-4b7720b6fc8a {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:48 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9208915-9288-4721-a886-09a16e63ec27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39250a06-81c5-4920-8881-aa1e4782fd02', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:48 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a 1073741824 Nov 03 17:07:48 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4871836-60c0-4055-83ca-17f6aa53e062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:48 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Volume volume-39250a06-81c5-4920-8881-aa1e4782fd02 (39250a06-81c5-4920-8881-aa1e4782fd02): created successfully Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4871836-60c0-4055-83ca-17f6aa53e062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (e44ae590-6cfa-4b54-bc10-a09383e2d1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-9d948817-dc96-426d-8ba5-83747a8ca26e tempest-VolumesActionsTest-1449331550 None] Created volume successfully. Nov 03 17:07:49 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a 1073741824" returned: 0 in 0.502s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:49 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a Nov 03 17:07:49 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Acquiring lock "cinder-39250a06-81c5-4920-8881-aa1e4782fd02-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Lock "cinder-39250a06-81c5-4920-8881-aa1e4782fd02-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Acquiring lock "cinder-quobyte-39250a06-81c5-4920-8881-aa1e4782fd02" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:49 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a" returned: 0 in 0.495s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Lock "cinder-quobyte-39250a06-81c5-4920-8881-aa1e4782fd02" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de18487-6cb8-4e7f-81b4-2d066e0b15c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bd11ab-c020-4b62-8030-6b2bc58660e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e4b601-81b3-449d-93e4-5ec986957678]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:49 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Volume volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a (c1fcef25-40a0-4f04-8dda-4b7720b6fc8a): created successfully Nov 03 17:07:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bd11ab-c020-4b62-8030-6b2bc58660e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (ba524b02-03e6-4c3e-a69d-a44bbcbea103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:50 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b6cd643d-fa7b-47a7-a7d0-69465bb7c8cd tempest-VolumesGetTest-1425846753 None] Created volume successfully. Nov 03 17:07:50 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02 Nov 03 17:07:50 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:50 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02" returned: 0 in 0.444s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:50 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02 Nov 03 17:07:50 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:50 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Flow 'volume_create_manager' (83c54c5f-bf0a-4ce3-be26-6258f5fac016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bf766f-f0a1-48d7-85a9-5607df228267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39250a06-81c5-4920-8881-aa1e4782fd02" returned: 0 in 0.394s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bf766f-f0a1-48d7-85a9-5607df228267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1241131573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb04eac1b55417aaf855db6cd183779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:51Z,use_quota=True,user_id='4e05321851b04f8293976c322b3777d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e563589a-3216-4538-aa95-c36caa5f5618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e563589a-3216-4538-aa95-c36caa5f5618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f66763d-4dfd-4e2d-8ff3-246d192ca085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f66763d-4dfd-4e2d-8ff3-246d192ca085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6', 'volume_name': 'volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1faf83b-a8ee-4dc8-a373-7e36e97f286c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1faf83b-a8ee-4dc8-a373-7e36e97f286c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd82a5f-777a-4f21-a02f-1246218d3469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:50 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Volume f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6', 'volume_size': 1} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1241131573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb04eac1b55417aaf855db6cd183779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:51Z,use_quota=True,user_id='4e05321851b04f8293976c322b3777d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Creating volume f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:50 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Lock "cinder-quobyte-39250a06-81c5-4920-8881-aa1e4782fd02" released by "delete_volume" :: held 0.983s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:50 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6 1073741824 Nov 03 17:07:50 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Created reservations ['2f3cd29a-d364-4b64-bdc1-301f8787e65d', '57b40549-95c7-4b98-b2da-572b3b3d5edf', '7c3dd9d8-9f3f-4126-b134-3b40abd609b4', 'c6814edc-ea9e-4b41-ba83-4179e7e20cd9'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:51 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:07:51 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:51 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.342s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:51 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Deleted volume successfully. Nov 03 17:07:51 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-548463df-515d-446f-a1a5-585f3a0e9564 tempest-VolumesActionsTest-646984728 None] Lock "cinder-39250a06-81c5-4920-8881-aa1e4782fd02-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6 1073741824" returned: 0 in 0.646s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:51 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6 Nov 03 17:07:51 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:51 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6" returned: 0 in 0.318s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd82a5f-777a-4f21-a02f-1246218d3469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9cfcd9-2577-40d4-8696-1ccaa3f22809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:51 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Volume volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6 (f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6): created successfully Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9cfcd9-2577-40d4-8696-1ccaa3f22809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Flow 'volume_create_manager' (83c54c5f-bf0a-4ce3-be26-6258f5fac016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:52 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-14ce73d6-2aca-48e8-b8ec-b099fee043fa tempest-AbsoluteLimitsTests-1334395180 None] Created volume successfully. Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (3c667b10-e831-4138-8fd6-fbc618c4b499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3c02d9-7588-4d29-be87-7ea4fdbd2495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3c02d9-7588-4d29-be87-7ea4fdbd2495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-326612071',display_name='tempest-VolumesGetTest-Volume-1677513482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41a866c-93d3-4530-bd3f-aa096a2c2a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:52Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0865b82e-3295-4faf-8f5d-d4b4e7b2e385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0865b82e-3295-4faf-8f5d-d4b4e7b2e385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97738404-c2a8-4fe6-b2e8-0c1018ebc1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97738404-c2a8-4fe6-b2e8-0c1018ebc1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41a866c-93d3-4530-bd3f-aa096a2c2a9e', 'volume_name': 'volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f65fa8e-09d9-4c48-84a5-112ee9cb3422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f65fa8e-09d9-4c48-84a5-112ee9cb3422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2a7d31-feef-4517-9d0c-606847189244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:52 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Volume e41a866c-93d3-4530-bd3f-aa096a2c2a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e', 'volume_size': 1} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-326612071',display_name='tempest-VolumesGetTest-Volume-1677513482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41a866c-93d3-4530-bd3f-aa096a2c2a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:52Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Creating volume e41a866c-93d3-4530-bd3f-aa096a2c2a9e {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:52 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:52 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e 1073741824 Nov 03 17:07:52 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:52 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (e60cb861-4fcd-424b-8c2f-fd56bcb2c5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cf4836-54f1-4068-81f2-b7a523bdd51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e 1073741824" returned: 0 in 0.763s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cf4836-54f1-4068-81f2-b7a523bdd51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1679019210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90aa958f-15b3-4aa4-a010-15864079acb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:53Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c3b57f-1e3c-4dc8-a434-491a85c4ddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c3b57f-1e3c-4dc8-a434-491a85c4ddcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b22909-677a-4a91-a477-d86abbb09c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b22909-677a-4a91-a477-d86abbb09c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90aa958f-15b3-4aa4-a010-15864079acb0', 'volume_name': 'volume-90aa958f-15b3-4aa4-a010-15864079acb0', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9239b6-5311-4c66-bc34-ed2c28cc00bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9239b6-5311-4c66-bc34-ed2c28cc00bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f7137c-c40f-47b6-a28d-11c686a982c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:52 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Volume 90aa958f-15b3-4aa4-a010-15864079acb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90aa958f-15b3-4aa4-a010-15864079acb0', 'volume_size': 1} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:53 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e Nov 03 17:07:53 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Acquiring lock "cinder-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Lock "cinder-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:53 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e" returned: 0 in 0.320s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1679019210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90aa958f-15b3-4aa4-a010-15864079acb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:53Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Creating volume 90aa958f-15b3-4aa4-a010-15864079acb0 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:53 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Acquiring lock "cinder-quobyte-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2a7d31-feef-4517-9d0c-606847189244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:53 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0 1073741824 Nov 03 17:07:53 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f796ab-640a-45fc-b57a-6d2f50b5b198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:53 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Volume volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e (e41a866c-93d3-4530-bd3f-aa096a2c2a9e): created successfully Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f796ab-640a-45fc-b57a-6d2f50b5b198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (3c667b10-e831-4138-8fd6-fbc618c4b499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Lock "cinder-quobyte-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6" acquired by "delete_volume" :: waited 0.055s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:53 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-74f92cc1-16cf-4b1a-ae20-ac3070c4dc7c tempest-VolumesGetTest-1425846753 None] Created volume successfully. Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3c5865-8e3c-4a99-b6ea-348eb8f58a25]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:53 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6 Nov 03 17:07:53 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:53 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6" returned: 0 in 0.385s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:53 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0 1073741824" returned: 0 in 0.502s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:53 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6 Nov 03 17:07:53 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:53 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0 Nov 03 17:07:53 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:54 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:54 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0" returned: 0 in 0.318s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6" returned: 0 in 0.376s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f7137c-c40f-47b6-a28d-11c686a982c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90aa958f-15b3-4aa4-a010-15864079acb0', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226fd510-bcc9-4fbe-9e21-e244b1111a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Lock "cinder-quobyte-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6" released by "delete_volume" :: held 0.836s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:54 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Volume volume-90aa958f-15b3-4aa4-a010-15864079acb0 (90aa958f-15b3-4aa4-a010-15864079acb0): created successfully Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226fd510-bcc9-4fbe-9e21-e244b1111a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (e60cb861-4fcd-424b-8c2f-fd56bcb2c5cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-e41a866c-93d3-4530-bd3f-aa096a2c2a9e-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:54 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-22bd18c1-eb1a-447a-96d1-e9fcc992daed tempest-VolumesActionsTest-1449331550 None] Created volume successfully. Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Lock "cinder-e41a866c-93d3-4530-bd3f-aa096a2c2a9e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Created reservations ['773af721-f96a-45e9-a2c2-8c1272067af1', '27a2a3c0-8b1e-4047-ac4e-4a251da71fe1', '674ae5b7-7756-41dd-8764-7a2435cedfbf', '4a3e54ff-1bb8-49fe-9590-f72c50b5d561'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-quobyte-e41a866c-93d3-4530-bd3f-aa096a2c2a9e" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-e41a866c-93d3-4530-bd3f-aa096a2c2a9e" acquired by "delete_volume" :: waited 0.034s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1f699f-d061-4453-9163-5e0318989fd4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:54 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:07:54 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:54 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e Nov 03 17:07:54 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:54 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.330s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:54 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Deleted volume successfully. Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1f3dd7b2-9810-4eea-aa7e-abcc023675c9 tempest-AbsoluteLimitsTests-1334395180 None] Lock "cinder-f3b249f0-11c1-4e37-9c0f-96b28bf4b4f6-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:54 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e" returned: 0 in 0.482s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:54 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e Nov 03 17:07:54 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Acquiring lock "cinder-90aa958f-15b3-4aa4-a010-15864079acb0-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Lock "cinder-90aa958f-15b3-4aa4-a010-15864079acb0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Acquiring lock "cinder-quobyte-90aa958f-15b3-4aa4-a010-15864079acb0" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Lock "cinder-quobyte-90aa958f-15b3-4aa4-a010-15864079acb0" acquired by "delete_volume" :: waited 0.014s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94b33fd-c449-4c29-bc6c-67b3feaaef42]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:55 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e41a866c-93d3-4530-bd3f-aa096a2c2a9e" returned: 0 in 0.298s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-e41a866c-93d3-4530-bd3f-aa096a2c2a9e" released by "delete_volume" :: held 0.844s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Created reservations ['711679b3-a681-4dd2-a624-95ac0d9f3f4c', 'f250ecac-67f1-4659-b201-1ffc1d7c0598', '58cc50ec-36f5-48a0-9379-ffb4ef9304a3', '24bef0df-8b84-49ff-9a27-943a2cbdc9bb'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:55 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0 Nov 03 17:07:55 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:55 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:07:55 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Lock "cinder-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-quobyte-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a" acquired by "delete_volume" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:55 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0" returned: 0 in 0.459s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:55 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[362400cb-b0d3-46c2-a22b-738c9e294e0e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.333s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:55 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0 Nov 03 17:07:55 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:55 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Deleted volume successfully. Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1d089af-5110-4508-8b24-9d08d91b375c tempest-VolumesGetTest-1425846753 None] Lock "cinder-e41a866c-93d3-4530-bd3f-aa096a2c2a9e-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:55 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a Nov 03 17:07:55 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:55 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-90aa958f-15b3-4aa4-a010-15864079acb0" returned: 0 in 0.298s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Lock "cinder-quobyte-90aa958f-15b3-4aa4-a010-15864079acb0" released by "delete_volume" :: held 0.810s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Created reservations ['f3d11d32-116c-4a88-b444-de69c9e099b8', 'f68de4f3-53b6-45df-be23-a54325693c13', '190fcf70-85a8-4578-9880-0281a20e1135', 'ffc8c904-a421-4082-b4e0-719495e34134'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:56 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a" returned: 0 in 0.452s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:56 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:07:56 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:56 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a Nov 03 17:07:56 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:56 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.280s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:56 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Deleted volume successfully. Nov 03 17:07:56 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a" returned: 0 in 0.290s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a" released by "delete_volume" :: held 0.811s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6254a8d1-665f-4d5f-a4c4-a3be1a6ca9ac tempest-VolumesActionsTest-646984728 None] Lock "cinder-90aa958f-15b3-4aa4-a010-15864079acb0-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Created reservations ['1613707c-9b34-412d-80dd-335a8fbaf66e', '609707e8-372f-40da-aaa6-dbab6ae860c1', 'c9798eea-6a58-4533-9d49-b96e2af0a765', '76f2599d-18b5-4b35-9ce5-f063beab5bda'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:56 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:07:56 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:56 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (13146487-b0c3-4e13-a5cb-200016ee4d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48118ff5-db38-4b44-9997-51e35170da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.413s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:07:57 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Deleted volume successfully. Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48118ff5-db38-4b44-9997-51e35170da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-611904976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00e667e-7612-47d8-9d39-014663eff5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:57Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67361e80-7807-4be3-9f48-309eebee3581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67361e80-7807-4be3-9f48-309eebee3581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580688c8-cd5b-44dd-bea8-59d9365ab2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580688c8-cd5b-44dd-bea8-59d9365ab2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00e667e-7612-47d8-9d39-014663eff5b1', 'volume_name': 'volume-f00e667e-7612-47d8-9d39-014663eff5b1', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693cb95f-9163-4f13-b105-5f6474f865bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693cb95f-9163-4f13-b105-5f6474f865bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c54192-0094-4707-a4c8-413e5ff2a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:57 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Volume f00e667e-7612-47d8-9d39-014663eff5b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00e667e-7612-47d8-9d39-014663eff5b1', 'volume_size': 1} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-611904976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00e667e-7612-47d8-9d39-014663eff5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f72b2db7e4e64405bb186c49c4a7b89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:57Z,use_quota=True,user_id='24436f6e66df4f74a4806dc15924b1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Creating volume f00e667e-7612-47d8-9d39-014663eff5b1 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:57 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:57 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1 1073741824 Nov 03 17:07:57 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f905edc-f4a4-43c7-8122-af3bc869c83c tempest-VolumesGetTest-1425846753 None] Lock "cinder-c1fcef25-40a0-4f04-8dda-4b7720b6fc8a-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (4f9bcb82-f9a4-4c65-a297-0fa6345f234a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e8b7a9-25cc-4f6d-a92e-a2134bd435e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e8b7a9-25cc-4f6d-a92e-a2134bd435e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1716643366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179067e4-3448-4955-9316-94efdc42668e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:57Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14feab39-2314-40c5-b5a2-fc9d90cf6d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14feab39-2314-40c5-b5a2-fc9d90cf6d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1571194-5ee5-4521-8ddd-23e2d7d1a413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1571194-5ee5-4521-8ddd-23e2d7d1a413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179067e4-3448-4955-9316-94efdc42668e', 'volume_name': 'volume-179067e4-3448-4955-9316-94efdc42668e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313d1730-173f-4fcc-965e-a2c39846d41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313d1730-173f-4fcc-965e-a2c39846d41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90a8d07-c16a-4ad4-9546-3beda17b3bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:57 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Volume 179067e4-3448-4955-9316-94efdc42668e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179067e4-3448-4955-9316-94efdc42668e', 'volume_size': 1} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:57 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1 1073741824" returned: 0 in 0.566s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:57 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1 Nov 03 17:07:57 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:58 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1" returned: 0 in 0.288s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.378s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1716643366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179067e4-3448-4955-9316-94efdc42668e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:07:57Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Creating volume 179067e4-3448-4955-9316-94efdc42668e {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:07:58 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c54192-0094-4707-a4c8-413e5ff2a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00e667e-7612-47d8-9d39-014663eff5b1', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:58 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e 1073741824 Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b974c92c-9ead-4a39-873e-56b508ef8358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:58 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:58 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Volume volume-f00e667e-7612-47d8-9d39-014663eff5b1 (f00e667e-7612-47d8-9d39-014663eff5b1): created successfully Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b974c92c-9ead-4a39-873e-56b508ef8358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Flow 'volume_create_manager' (13146487-b0c3-4e13-a5cb-200016ee4d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:58 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-53fbaa04-f902-4f78-beea-c28695a78306 tempest-VolumesActionsTest-1449331550 None] Created volume successfully. Nov 03 17:07:58 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e 1073741824" returned: 0 in 0.500s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:58 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e Nov 03 17:07:58 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:07:58 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e" returned: 0 in 0.260s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90a8d07-c16a-4ad4-9546-3beda17b3bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179067e4-3448-4955-9316-94efdc42668e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a5b240-ace3-420b-816b-3c7125a6f524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:07:58 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Volume volume-179067e4-3448-4955-9316-94efdc42668e (179067e4-3448-4955-9316-94efdc42668e): created successfully Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a5b240-ace3-420b-816b-3c7125a6f524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:07:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (4f9bcb82-f9a4-4c65-a297-0fa6345f234a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:07:58 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-bd437222-53ce-4a0a-a38e-2ba167855a23 tempest-VolumesGetTest-1425846753 None] Created volume successfully. Nov 03 17:07:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Acquiring lock "cinder-f00e667e-7612-47d8-9d39-014663eff5b1-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Lock "cinder-f00e667e-7612-47d8-9d39-014663eff5b1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Acquiring lock "cinder-quobyte-f00e667e-7612-47d8-9d39-014663eff5b1" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:07:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Lock "cinder-quobyte-f00e667e-7612-47d8-9d39-014663eff5b1" acquired by "delete_volume" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:07:59 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5964ffee-0b6e-442d-91d5-f1d324a8d0f6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:07:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:07:59 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1 Nov 03 17:07:59 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (ad8476a2-b4b1-436b-b95a-cbe0b89bdc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db66fc96-6fb2-4ab6-a2c1-491fd4a4a287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:00 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db66fc96-6fb2-4ab6-a2c1-491fd4a4a287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1942709154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ce3ea6-902f-4859-84f8-4f4d9b29a07d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=179067e4-3448-4955-9316-94efdc42668e,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:00Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1cc6e3-d995-457e-bae3-2e6d0ced41b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1cc6e3-d995-457e-bae3-2e6d0ced41b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a402d8-87c9-4323-825c-652888b9d304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1" returned: 0 in 0.541s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:00 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1 Nov 03 17:08:00 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a402d8-87c9-4323-825c-652888b9d304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a2ce3ea6-902f-4859-84f8-4f4d9b29a07d', 'volume_name': 'volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d', 'volume_size': 1, 'source_volid': '179067e4-3448-4955-9316-94efdc42668e', 'source_volstatus': 'available'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6708a7c-5282-4bc1-9c8a-8a1dc9e7ed07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6708a7c-5282-4bc1-9c8a-8a1dc9e7ed07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b059f263-b781-4d74-af0c-ee30889f7fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:00 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Volume a2ce3ea6-902f-4859-84f8-4f4d9b29a07d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d', 'volume_size': 1, 'source_volid': '179067e4-3448-4955-9316-94efdc42668e', 'source_volstatus': 'available'} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:00 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Cloning volume 179067e4-3448-4955-9316-94efdc42668e to volume a2ce3ea6-902f-4859-84f8-4f4d9b29a07d Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Creating offline snapshot 0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee of volume 179067e4-3448-4955-9316-94efdc42668e {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2748faba-2d16-46f4-9eb0-371b8cc9db68]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:00 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e Nov 03 17:08:00 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:00 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f00e667e-7612-47d8-9d39-014663eff5b1" returned: 0 in 0.312s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Lock "cinder-quobyte-f00e667e-7612-47d8-9d39-014663eff5b1" released by "delete_volume" :: held 0.915s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Created reservations ['f7080ca4-b1d7-4102-9448-302642d6ae8f', '3470e030-a138-4576-b1cb-1d92c10757a7', 'c156cea1-7d24-4e31-8c03-0855030e0805', '00982605-d898-42ab-bde6-fbe23ed81e1e'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:00 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:00 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:00 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e" returned: 0 in 0.425s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:00 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee 1G Nov 03 17:08:00 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:01 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.324s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:01 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:01 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Deleted volume successfully. Nov 03 17:08:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c1b29357-a055-46f9-8c95-a5879af53d4c tempest-VolumesActionsTest-1449331550 None] Lock "cinder-f00e667e-7612-47d8-9d39-014663eff5b1-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:01 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee 1G" returned: 0 in 0.514s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179067e4-3448-4955-9316-94efdc42668e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:01 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179067e4-3448-4955-9316-94efdc42668e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee Nov 03 17:08:01 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:01 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-179067e4-3448-4955-9316-94efdc42668e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee" returned: 0 in 0.317s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:01 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee is being set with open permissions: ugo+rw Nov 03 17:08:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:01 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee Nov 03 17:08:01 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:02 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee" returned: 0 in 0.287s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:02 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.info Nov 03 17:08:02 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:02 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.info" returned: 0 in 0.391s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:02 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.info is being set with open permissions: ugo+rw Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:02 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.info Nov 03 17:08:02 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:02 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.info" returned: 0 in 0.331s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-quobyte-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] snapshot: 0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee, volume: a2ce3ea6-902f-4859-84f8-4f4d9b29a07d, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[403b719b-59be-40a0-a4bb-482645a6de46]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:03 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee Nov 03 17:08:03 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:03 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee" returned: 0 in 0.608s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-179067e4-3448-4955-9316-94efdc42668e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:08:03 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[395e5764-558c-4283-a63b-8869fff7d904]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:03 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e Nov 03 17:08:03 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:03 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Flow 'volume_create_manager' (5d7a2b24-9ba2-497b-9215-1c3dc171240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7415415e-cb13-4039-9671-b4bdc71b64c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7415415e-cb13-4039-9671-b4bdc71b64c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-767308877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e0a53b-5fe1-42d9-a354-990335d94534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d10fb441c7c4a048dacc57570534453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:04Z,use_quota=True,user_id='2c68748396944491b9ed7067ad8d5b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441b517f-4423-4475-aae9-87d31e2ccec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441b517f-4423-4475-aae9-87d31e2ccec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9906099f-a40c-492b-a8b4-92e25ddef5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9906099f-a40c-492b-a8b4-92e25ddef5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e0a53b-5fe1-42d9-a354-990335d94534', 'volume_name': 'volume-79e0a53b-5fe1-42d9-a354-990335d94534', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f31b3f-c6e9-4e77-b9d4-ef8893fd1111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f31b3f-c6e9-4e77-b9d4-ef8893fd1111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827b029f-2026-4562-b7d1-f35f0892f22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:04 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Volume 79e0a53b-5fe1-42d9-a354-990335d94534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e0a53b-5fe1-42d9-a354-990335d94534', 'volume_size': 1} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:04 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e" returned: 0 in 0.563s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:08:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:04 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d Nov 03 17:08:04 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:07 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Flow 'volume_create_manager' (04f51d64-8a0e-4cbf-9e58-663d82ebea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c34e01-508a-4f19-8044-dd6178f227ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c34e01-508a-4f19-8044-dd6178f227ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-858589468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3488d54-83a2-47fc-9a95-bcaa6fa9530d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b133de72c74fda91907fe808bd5f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:08Z,use_quota=True,user_id='f7569865282447f19ecbbb55f7b64094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c537e35e-985e-4fff-a0c7-de9fb19ab326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c537e35e-985e-4fff-a0c7-de9fb19ab326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d094795a-471a-44ee-adba-2978053edd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d094795a-471a-44ee-adba-2978053edd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3488d54-83a2-47fc-9a95-bcaa6fa9530d', 'volume_name': 'volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24da005c-f914-4ecb-ae82-438aa5079011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24da005c-f914-4ecb-ae82-438aa5079011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7287c01-3690-4b09-97fb-e85fe1b95ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:08 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Volume c3488d54-83a2-47fc-9a95-bcaa6fa9530d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d', 'volume_size': 1} Nov 03 17:08:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:12 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d" returned: 0 in 7.932s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:08:12 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Converted 1024.00 MB image at 129.08 MB/s Nov 03 17:08:12 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d is being set with open permissions: ugo+rw Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:12 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d Nov 03 17:08:12 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:12 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d" returned: 0 in 0.303s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d" released by "_copy_volume_from_snapshot" :: held 9.531s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=114,cinder:UPDATE=124,cinder:INSERT=32,cinder:DELETE=12 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-quobyte-0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Deleting offline snapshot 0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee of volume 179067e4-3448-4955-9316-94efdc42668e {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] snapshot_file for this snap is: volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c93df5-1d28-42fa-aa76-6197e769b207]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:12 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee Nov 03 17:08:12 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:12 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee" returned: 0 in 0.471s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-179067e4-3448-4955-9316-94efdc42668e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[affe5020-500f-42c3-8819-6b6f1fc2f869]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:13 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e Nov 03 17:08:13 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:13 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e" returned: 0 in 0.557s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:13 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee Nov 03 17:08:13 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:14 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee" returned: 0 in 0.462s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:14 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee Nov 03 17:08:14 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:14 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e.0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee" returned: 0 in 0.264s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-0cc7a94a-4ea4-4651-a4f8-f6f1f1d553ee" released by "_delete_snapshot" :: held 1.873s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=124,cinder:SELECT=76,cinder:DELETE=10,cinder:INSERT=24 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.910s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.285s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-767308877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e0a53b-5fe1-42d9-a354-990335d94534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d10fb441c7c4a048dacc57570534453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:04Z,use_quota=True,user_id='2c68748396944491b9ed7067ad8d5b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Creating volume 79e0a53b-5fe1-42d9-a354-990335d94534 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:14 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:14 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534 1073741824 Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b059f263-b781-4d74-af0c-ee30889f7fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d', 'volume_size': 1, 'source_volid': '179067e4-3448-4955-9316-94efdc42668e', 'source_volstatus': 'available'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:14 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6babf9-ba93-43c1-84cf-35e035344f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:14 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Volume volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d (a2ce3ea6-902f-4859-84f8-4f4d9b29a07d): created successfully Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6babf9-ba93-43c1-84cf-35e035344f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (ad8476a2-b4b1-436b-b95a-cbe0b89bdc77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:14 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-fbf40f1a-f1ce-4e08-87d6-fd4af0e13de2 tempest-VolumesGetTest-1425846753 None] Created volume successfully. Nov 03 17:08:14 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534 1073741824" returned: 0 in 0.550s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:15 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534 Nov 03 17:08:15 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:15 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534" returned: 0 in 0.325s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.231s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-858589468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3488d54-83a2-47fc-9a95-bcaa6fa9530d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b133de72c74fda91907fe808bd5f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:08Z,use_quota=True,user_id='f7569865282447f19ecbbb55f7b64094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Creating volume c3488d54-83a2-47fc-9a95-bcaa6fa9530d {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:15 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827b029f-2026-4562-b7d1-f35f0892f22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e0a53b-5fe1-42d9-a354-990335d94534', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:15 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d 1073741824 Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560dd6d7-1fef-40e2-9c9e-4302cd3dbe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:15 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:15 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Volume volume-79e0a53b-5fe1-42d9-a354-990335d94534 (79e0a53b-5fe1-42d9-a354-990335d94534): created successfully Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560dd6d7-1fef-40e2-9c9e-4302cd3dbe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Flow 'volume_create_manager' (5d7a2b24-9ba2-497b-9215-1c3dc171240d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:15 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3d6a4bbf-1174-45e9-8dde-3e3c31adc88e tempest-VolumesTransfersV357Test-917282929 None] Created volume successfully. Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (c5be55a4-3e26-42b6-a06a-fa4b27548124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063ec6d7-066f-4ed9-9fff-bb9ba6018c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063ec6d7-066f-4ed9-9fff-bb9ba6018c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1531187575',display_name='tempest-VolumesGetTest-Volume-1709722096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999c059c-a81d-4557-8f3d-3bca43fddd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:16Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad99a1f9-560c-4711-9cec-73913cd94c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad99a1f9-560c-4711-9cec-73913cd94c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4686d4-1c05-488d-a96a-6a666c9f3c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4686d4-1c05-488d-a96a-6a666c9f3c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '999c059c-a81d-4557-8f3d-3bca43fddd8c', 'volume_name': 'volume-999c059c-a81d-4557-8f3d-3bca43fddd8c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:15 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd600d7-003e-4f94-9a86-a25b53e10b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd600d7-003e-4f94-9a86-a25b53e10b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8ef360-f2f8-4bc4-8612-b55739e11ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:15 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Volume 999c059c-a81d-4557-8f3d-3bca43fddd8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-999c059c-a81d-4557-8f3d-3bca43fddd8c', 'volume_size': 1} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d 1073741824" returned: 0 in 0.546s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:15 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d Nov 03 17:08:15 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:16 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d" returned: 0 in 0.280s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1531187575',display_name='tempest-VolumesGetTest-Volume-1709722096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999c059c-a81d-4557-8f3d-3bca43fddd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:16Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Creating volume 999c059c-a81d-4557-8f3d-3bca43fddd8c {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:16 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7287c01-3690-4b09-97fb-e85fe1b95ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14aa899-956e-4f5a-b939-3296f53cfec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:16 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c 1073741824 Nov 03 17:08:16 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:16 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Volume volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d (c3488d54-83a2-47fc-9a95-bcaa6fa9530d): created successfully Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14aa899-956e-4f5a-b939-3296f53cfec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Flow 'volume_create_manager' (04f51d64-8a0e-4cbf-9e58-663d82ebea08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:16 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-119fbb05-cb0b-4b45-9219-f3851155946e tempest-AttachVolumeNegativeTest-1504269075 None] Created volume successfully. Nov 03 17:08:16 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c 1073741824" returned: 0 in 0.689s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:17 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c Nov 03 17:08:17 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:17 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c" returned: 0 in 0.375s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8ef360-f2f8-4bc4-8612-b55739e11ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999c059c-a81d-4557-8f3d-3bca43fddd8c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebdc10a-1e91-4031-a08d-4d7b14783e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:17 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Volume volume-999c059c-a81d-4557-8f3d-3bca43fddd8c (999c059c-a81d-4557-8f3d-3bca43fddd8c): created successfully Nov 03 17:08:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebdc10a-1e91-4031-a08d-4d7b14783e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (c5be55a4-3e26-42b6-a06a-fa4b27548124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-93b6fb53-61d0-40cd-9252-7cef754d7562 req-4a885618-22d9-4c95-9405-43959ad19fba tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-93b6fb53-61d0-40cd-9252-7cef754d7562 req-4a885618-22d9-4c95-9405-43959ad19fba tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-93b6fb53-61d0-40cd-9252-7cef754d7562 req-4a885618-22d9-4c95-9405-43959ad19fba tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:17 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-515fad4e-a0bd-48a7-931b-cc26ff637246 tempest-VolumesGetTest-1425846753 None] Created volume successfully. Nov 03 17:08:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-93b6fb53-61d0-40cd-9252-7cef754d7562 req-4a885618-22d9-4c95-9405-43959ad19fba tempest-AttachVolumeNegativeTest-1504269075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10f5fa77-c9d6-44a8-9429-5694008253f5', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:08:17 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-93b6fb53-61d0-40cd-9252-7cef754d7562 req-4a885618-22d9-4c95-9405-43959ad19fba tempest-AttachVolumeNegativeTest-1504269075 None] attachment_update completed successfully. Nov 03 17:08:17 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-373b3ad1-8738-4a0a-959d-027e74f483cd tempest-VolumesTransfersV357Test-2074766211 None] Transfer volume completed successfully. Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-999c059c-a81d-4557-8f3d-3bca43fddd8c-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Lock "cinder-999c059c-a81d-4557-8f3d-3bca43fddd8c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-quobyte-999c059c-a81d-4557-8f3d-3bca43fddd8c" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-999c059c-a81d-4557-8f3d-3bca43fddd8c" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f349a4-a39b-4d2d-97ac-6165f4ccd68d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:18 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c Nov 03 17:08:18 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Acquiring lock "cinder-79e0a53b-5fe1-42d9-a354-990335d94534-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Lock "cinder-79e0a53b-5fe1-42d9-a354-990335d94534-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:18 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c" returned: 0 in 0.493s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:18 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Acquiring lock "cinder-quobyte-79e0a53b-5fe1-42d9-a354-990335d94534" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:18 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Lock "cinder-quobyte-79e0a53b-5fe1-42d9-a354-990335d94534" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f53ea8-4429-49bf-abe2-54e4c3e735a1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:19 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534 Nov 03 17:08:19 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:19 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-999c059c-a81d-4557-8f3d-3bca43fddd8c" returned: 0 in 0.281s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-999c059c-a81d-4557-8f3d-3bca43fddd8c" released by "delete_volume" :: held 0.832s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Created reservations ['5878530f-402c-4ea4-8230-1e4f7df9b463', '7cc40abf-a591-4ece-b447-b001f394c66b', '4b902d8e-df0c-403e-95ab-486e7cf943c0', '3811a106-26b1-4b8d-b5a4-6126e4e4b460'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:19 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:19 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:19 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534" returned: 0 in 0.429s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:19 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534 Nov 03 17:08:19 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Lock "cinder-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-quobyte-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:19 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.416s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:19 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Deleted volume successfully. Nov 03 17:08:19 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1646f61-bf7c-4c15-85e7-50a8ddf27bae]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-79e0a53b-5fe1-42d9-a354-990335d94534" returned: 0 in 0.407s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ae637896-0534-43e0-b83c-1c1d78613c0d tempest-VolumesGetTest-1425846753 None] Lock "cinder-999c059c-a81d-4557-8f3d-3bca43fddd8c-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Lock "cinder-quobyte-79e0a53b-5fe1-42d9-a354-990335d94534" released by "delete_volume" :: held 0.901s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:19 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Created reservations ['e0b4d998-8b36-427a-9420-294e332f26a7', '13c1fdf3-9199-440d-8dff-5e9bb9346e22', '18362c4c-7c7b-49b8-aa3a-1e6e77185cb9', '7212769e-f235-42d0-8b7a-7a92f76e9919'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:19 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d Nov 03 17:08:19 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:20 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:20 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:20 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.282s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:20 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Deleted volume successfully. Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1502fdfc-d898-4f4c-8589-30b4b700cfa7 tempest-VolumesTransfersV357Test-664338880 None] Lock "cinder-79e0a53b-5fe1-42d9-a354-990335d94534-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:20 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d" returned: 0 in 0.658s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:20 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d Nov 03 17:08:20 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:20 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-87267736-4129-4778-b73a-2486c92e5db4 req-0c438a0f-72cf-4dcd-af81-f13568f396a8 tempest-AttachVolumeNegativeTest-1504269075 None] Terminate volume connection completed successfully. Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-87267736-4129-4778-b73a-2486c92e5db4 req-0c438a0f-72cf-4dcd-af81-f13568f396a8 tempest-AttachVolumeNegativeTest-1504269075 None] Deleting attachment 10f5fa77-c9d6-44a8-9429-5694008253f5. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:08:20 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d" returned: 0 in 0.298s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d" released by "delete_volume" :: held 1.040s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Created reservations ['ed494e18-1a31-4700-a9ef-e8693e77e73b', '471516d4-b4dc-4027-bb67-5760d1e9b13e', '04110ddc-5519-4653-a51e-500a341178c4', '95dfd293-7989-474d-a673-e051f061f4bd'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:20 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:20 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:21 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.260s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:21 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Deleted volume successfully. Nov 03 17:08:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eb6247b2-8965-49a6-b154-2c69f28ba466 tempest-VolumesGetTest-1425846753 None] Lock "cinder-a2ce3ea6-902f-4859-84f8-4f4d9b29a07d-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Flow 'volume_create_manager' (ebf8ed2f-9344-47a7-a90a-ba48ed68bd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf88b8bc-12e1-49ae-be5b-28a5d09fb931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf88b8bc-12e1-49ae-be5b-28a5d09fb931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1298232362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38789f50-aba6-440a-a91b-cfcbcc5c4f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d10fb441c7c4a048dacc57570534453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:22Z,use_quota=True,user_id='2c68748396944491b9ed7067ad8d5b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d41cb3-be07-49db-b313-f61175617a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d41cb3-be07-49db-b313-f61175617a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c273aa2-c2ca-4eaf-b90b-6b9985890321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c273aa2-c2ca-4eaf-b90b-6b9985890321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38789f50-aba6-440a-a91b-cfcbcc5c4f69', 'volume_name': 'volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd1a640-a35e-4da0-9002-bf6f255769d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd1a640-a35e-4da0-9002-bf6f255769d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fae9d8-8bf6-4efa-b0d4-3cd2cd34045a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Volume 38789f50-aba6-440a-a91b-cfcbcc5c4f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69', 'volume_size': 1} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1298232362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38789f50-aba6-440a-a91b-cfcbcc5c4f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d10fb441c7c4a048dacc57570534453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:22Z,use_quota=True,user_id='2c68748396944491b9ed7067ad8d5b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Creating volume 38789f50-aba6-440a-a91b-cfcbcc5c4f69 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:22 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-179067e4-3448-4955-9316-94efdc42668e-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:22 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69 1073741824 Nov 03 17:08:22 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Lock "cinder-179067e4-3448-4955-9316-94efdc42668e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Flow 'volume_create_manager' (c41a9c10-ef20-4a63-b22b-abc33910e3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ffd9b6-5a75-4502-af39-991e91a69b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ffd9b6-5a75-4502-af39-991e91a69b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-24224000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa80c13-8c81-4c96-87d1-4569070b5cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13145d2d4df343479783dad3edc563d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:22Z,use_quota=True,user_id='d97107a352ee41449a1cbf9694b8d1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a806e7-ced2-433f-b5f7-14f982fcb342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a806e7-ced2-433f-b5f7-14f982fcb342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b03cab-4e53-4f0e-935b-52893628fa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b03cab-4e53-4f0e-935b-52893628fa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa80c13-8c81-4c96-87d1-4569070b5cb8', 'volume_name': 'volume-baa80c13-8c81-4c96-87d1-4569070b5cb8', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c620cc9-7fc3-4071-8d65-ced5bbf330d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c620cc9-7fc3-4071-8d65-ced5bbf330d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7cb87a-9dc8-429b-9464-c074ec8275a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:22 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Volume baa80c13-8c81-4c96-87d1-4569070b5cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa80c13-8c81-4c96-87d1-4569070b5cb8', 'volume_size': 1} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-quobyte-179067e4-3448-4955-9316-94efdc42668e" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-179067e4-3448-4955-9316-94efdc42668e" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf031927-eddc-4d5b-9368-92b08df1e567]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:22 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e Nov 03 17:08:22 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:22 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69 1073741824" returned: 0 in 0.599s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:23 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69 Nov 03 17:08:23 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:23 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e" returned: 0 in 0.463s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:23 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e Nov 03 17:08:23 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:23 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69" returned: 0 in 0.272s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-24224000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa80c13-8c81-4c96-87d1-4569070b5cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13145d2d4df343479783dad3edc563d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:22Z,use_quota=True,user_id='d97107a352ee41449a1cbf9694b8d1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Creating volume baa80c13-8c81-4c96-87d1-4569070b5cb8 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:23 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fae9d8-8bf6-4efa-b0d4-3cd2cd34045a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f90339-8ffa-42d1-a37c-9a59e9a89f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:23 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8 1073741824 Nov 03 17:08:23 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:23 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Volume volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69 (38789f50-aba6-440a-a91b-cfcbcc5c4f69): created successfully Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f90339-8ffa-42d1-a37c-9a59e9a89f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Flow 'volume_create_manager' (ebf8ed2f-9344-47a7-a90a-ba48ed68bd77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:23 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d65aaa6d-5f13-42ad-a3aa-8bc021f45880 tempest-VolumesTransfersV357Test-917282929 None] Created volume successfully. Nov 03 17:08:23 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-179067e4-3448-4955-9316-94efdc42668e" returned: 0 in 0.401s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-179067e4-3448-4955-9316-94efdc42668e" released by "delete_volume" :: held 0.961s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Created reservations ['cd793204-9104-419a-9799-68ded9d18f6f', 'a22503a3-9753-43df-b658-cbb258cfe4da', 'bde78b46-c704-46ab-88c7-92b310e669e8', '1fa3598d-c896-40a9-9aeb-77b2899eefad'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:23 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:23 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:23 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8 1073741824" returned: 0 in 0.633s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:24 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8 Nov 03 17:08:24 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:24 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.340s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Deleted volume successfully. Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b180802c-1e29-4a83-93eb-6c4651b3c8b4 tempest-VolumesGetTest-1425846753 None] Lock "cinder-179067e4-3448-4955-9316-94efdc42668e-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:24 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8" returned: 0 in 0.380s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7cb87a-9dc8-429b-9464-c074ec8275a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa80c13-8c81-4c96-87d1-4569070b5cb8', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936403e6-82d5-4c2a-9dff-4a82ed5fd1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:24 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Volume volume-baa80c13-8c81-4c96-87d1-4569070b5cb8 (baa80c13-8c81-4c96-87d1-4569070b5cb8): created successfully Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936403e6-82d5-4c2a-9dff-4a82ed5fd1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Flow 'volume_create_manager' (c41a9c10-ef20-4a63-b22b-abc33910e3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-9cf59d6f-5d01-4aeb-a302-98ff17ae4792 tempest-VolumesListAdminTestJSON-1734664432 None] Created volume successfully. Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Acquiring lock "cinder-38789f50-aba6-440a-a91b-cfcbcc5c4f69-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Lock "cinder-38789f50-aba6-440a-a91b-cfcbcc5c4f69-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Acquiring lock "cinder-quobyte-38789f50-aba6-440a-a91b-cfcbcc5c4f69" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Lock "cinder-quobyte-38789f50-aba6-440a-a91b-cfcbcc5c4f69" acquired by "delete_volume" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[724e3652-0bd2-453c-8592-d8bfe92a26c0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:24 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69 Nov 03 17:08:24 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:25 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69" returned: 0 in 0.442s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:25 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69 Nov 03 17:08:25 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:25 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38789f50-aba6-440a-a91b-cfcbcc5c4f69" returned: 0 in 0.281s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Lock "cinder-quobyte-38789f50-aba6-440a-a91b-cfcbcc5c4f69" released by "delete_volume" :: held 0.781s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Created reservations ['0e292eed-98be-412e-bcc3-bd1025ef544d', 'c469b2f0-56c2-43e1-9456-f8277a413e53', 'e254b026-ae21-41b1-b32e-16b66cad6ca4', 'bd7ac1e3-4be4-497c-8240-e09b1ac9db25'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:25 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:25 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:25 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (13a433a8-5a94-4d23-9486-27d037ecc850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3faa32-6ebb-4a76-8ba6-ba865bedc4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3faa32-6ebb-4a76-8ba6-ba865bedc4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-890141445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4733eb6e-f557-4e60-a7f0-fcad9686c13d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:26Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9af485a-42d9-4648-a8f0-174ad009da5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9af485a-42d9-4648-a8f0-174ad009da5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:26 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3d2194-9e58-4cbe-87df-7d04476b896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.image.glance [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Creating Keystone auth plugin from conf {{(pid=86661) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "cinder-c3488d54-83a2-47fc-9a95-bcaa6fa9530d-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.462s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:26 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Deleted volume successfully. Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-c3488d54-83a2-47fc-9a95-bcaa6fa9530d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8e32a464-bbbb-4d85-b9a9-57e1e148a519 tempest-VolumesTransfersV357Test-664338880 None] Lock "cinder-38789f50-aba6-440a-a91b-cfcbcc5c4f69-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "cinder-quobyte-c3488d54-83a2-47fc-9a95-bcaa6fa9530d" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-quobyte-c3488d54-83a2-47fc-9a95-bcaa6fa9530d" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7241fc33-5765-42d8-877e-3932c78326df]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:26 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Flow 'volume_create_manager' (4a4d8932-8e8d-43aa-8f68-1c75398d1be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:26 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6d137e-743d-4511-99a9-d9c45b3d25b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6d137e-743d-4511-99a9-d9c45b3d25b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-745256700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2219af-830f-4ad6-b973-231748e2de62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13145d2d4df343479783dad3edc563d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:26Z,use_quota=True,user_id='d97107a352ee41449a1cbf9694b8d1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1704f64-f1bf-4888-b7f8-244aa91da6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1704f64-f1bf-4888-b7f8-244aa91da6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d104cc8f-bc82-4a33-9286-e66b50091f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d104cc8f-bc82-4a33-9286-e66b50091f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea2219af-830f-4ad6-b973-231748e2de62', 'volume_name': 'volume-ea2219af-830f-4ad6-b973-231748e2de62', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa7a888-2e13-40a0-bb10-439f363dab24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa7a888-2e13-40a0-bb10-439f363dab24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257ee0de-4e92-44b7-83be-684029ffb8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:26 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Volume ea2219af-830f-4ad6-b973-231748e2de62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea2219af-830f-4ad6-b973-231748e2de62', 'volume_size': 1} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-745256700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2219af-830f-4ad6-b973-231748e2de62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13145d2d4df343479783dad3edc563d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:26Z,use_quota=True,user_id='d97107a352ee41449a1cbf9694b8d1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Creating volume ea2219af-830f-4ad6-b973-231748e2de62 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:26 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:26 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62 1073741824 Nov 03 17:08:26 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3d2194-9e58-4cbe-87df-7d04476b896b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4733eb6e-f557-4e60-a7f0-fcad9686c13d', 'volume_name': 'volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0304fffe-3b37-45bd-acc9-1ed2db7e6c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0304fffe-3b37-45bd-acc9-1ed2db7e6c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefe1a1a-2bed-41b1-a6f4-012a9ef50829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:26 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Volume 4733eb6e-f557-4e60-a7f0-fcad9686c13d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Trying to clone 4733eb6e-f557-4e60-a7f0-fcad9686c13d from image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]). {{(pid=86661) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:08:26 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d" returned: 0 in 0.515s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:26 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d Nov 03 17:08:26 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:08:27 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:27 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c3488d54-83a2-47fc-9a95-bcaa6fa9530d" returned: 0 in 0.361s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:27 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62 1073741824" returned: 0 in 0.637s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-quobyte-c3488d54-83a2-47fc-9a95-bcaa6fa9530d" released by "delete_volume" :: held 0.958s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf8f8f8-2ad1-479f-9ed5-1238179ada2b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:27 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62 Nov 03 17:08:27 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Created reservations ['fcb649a5-9ffc-4ff3-a99c-3a937c7b6f47', 'b8de2c73-ab66-410b-9d38-a85e555d5c03', 'e3b05db1-d39a-4f05-91ba-746e1026d0a7', '747c7ace-ae0b-4847-9b02-07e9db061afd'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:27 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD Nov 03 17:08:27 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:27 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:27 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:27 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62" returned: 0 in 0.308s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257ee0de-4e92-44b7-83be-684029ffb8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea2219af-830f-4ad6-b973-231748e2de62', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a5e37b-3c7a-40b8-87b4-6a2d59eebd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:27 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Temporary image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 is fetched for user 04accbf0743a49e186f44e11b02da6cf. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:08:27 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Volume volume-ea2219af-830f-4ad6-b973-231748e2de62 (ea2219af-830f-4ad6-b973-231748e2de62): created successfully Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a5e37b-3c7a-40b8-87b4-6a2d59eebd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Flow 'volume_create_manager' (4a4d8932-8e8d-43aa-8f68-1c75398d1be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ebd17945-cce4-4535-812f-39d2f943ecff tempest-VolumesListAdminTestJSON-1734664432 None] Created volume successfully. Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[537707de-64d9-4f70-a2fe-4064c78c85ca]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:27 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.297s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Deleted volume successfully. Nov 03 17:08:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2c198238-3cde-4a53-90eb-fb665040efbc tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-c3488d54-83a2-47fc-9a95-bcaa6fa9530d-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:27 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD Nov 03 17:08:27 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:28 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-890141445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4733eb6e-f557-4e60-a7f0-fcad9686c13d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:26Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Creating volume 4733eb6e-f557-4e60-a7f0-fcad9686c13d {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:28 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:28 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d 1073741824 Nov 03 17:08:28 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "cinder-46512db0-0b29-4cf4-aeb9-bc68044d2992-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-46512db0-0b29-4cf4-aeb9-bc68044d2992-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "cinder-quobyte-46512db0-0b29-4cf4-aeb9-bc68044d2992" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-quobyte-46512db0-0b29-4cf4-aeb9-bc68044d2992" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[213224de-ba05-418f-9b32-3c818cb5ef96]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:28 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992 Nov 03 17:08:28 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:28 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d 1073741824" returned: 0 in 0.598s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:28 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d Nov 03 17:08:28 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:29 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992" returned: 0 in 0.521s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:29 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992 Nov 03 17:08:29 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:29 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d" returned: 0 in 0.383s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Attempting download of 4d6008ab-d7f4-4403-8d44-c7c2165d2356 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}])) to volume 4733eb6e-f557-4e60-a7f0-fcad9686c13d. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Flow 'volume_create_manager' (e792d4d9-a207-4fa2-be90-777808e7d2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0ab038-191a-42f8-a1fe-aeb2e6658607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0ab038-191a-42f8-a1fe-aeb2e6658607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1136294390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8623178b-3e2c-436d-8444-7943aaac90f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13145d2d4df343479783dad3edc563d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:29Z,use_quota=True,user_id='d97107a352ee41449a1cbf9694b8d1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b89352-34be-4068-8df8-72ad235b0565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b89352-34be-4068-8df8-72ad235b0565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf441eda-03f5-4a7f-985b-3a439d1a92a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf441eda-03f5-4a7f-985b-3a439d1a92a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8623178b-3e2c-436d-8444-7943aaac90f9', 'volume_name': 'volume-8623178b-3e2c-436d-8444-7943aaac90f9', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b859e1-3511-401b-9b10-e74f2bf23d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b859e1-3511-401b-9b10-e74f2bf23d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957b76e8-cfab-4738-a62c-d24b129439de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:29 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Volume 8623178b-3e2c-436d-8444-7943aaac90f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8623178b-3e2c-436d-8444-7943aaac90f9', 'volume_size': 1} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1136294390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8623178b-3e2c-436d-8444-7943aaac90f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13145d2d4df343479783dad3edc563d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:29Z,use_quota=True,user_id='d97107a352ee41449a1cbf9694b8d1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Creating volume 8623178b-3e2c-436d-8444-7943aaac90f9 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:29 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:29 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b52027e-51d9-4532-9f16-2cccf230a092]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_7arf9b0t {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:29 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9 1073741824 Nov 03 17:08:29 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-46512db0-0b29-4cf4-aeb9-bc68044d2992" returned: 0 in 0.332s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-quobyte-46512db0-0b29-4cf4-aeb9-bc68044d2992" released by "delete_volume" :: held 0.923s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Created reservations ['7ded2953-21ee-443d-9a85-2f0e75aaf2ac', 'ad32c5a9-eabd-4819-a09d-395953820bf4', '8bed3058-c091-4e0e-9b64-6e4be2724d0b', '4a8713ef-b5b3-450e-a425-43d48bfc1924'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:29 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_7arf9b0t Nov 03 17:08:29 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:29 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:29 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:29 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:29 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:29 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_7arf9b0t" returned: 0 in 0.441s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_7arf9b0t {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:30 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_7arf9b0t Nov 03 17:08:30 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:30 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9 1073741824" returned: 0 in 0.664s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:30 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.429s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Deleted volume successfully. Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:30 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.463s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:08:30 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9 Nov 03 17:08:30 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a1182bd2-3be9-44ac-ac9e-26fad6f2ac5d tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-46512db0-0b29-4cf4-aeb9-bc68044d2992-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:30 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_7arf9b0t" returned: 1 in 0.498s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_7arf9b0t' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2373ea3a-ce14-48bd-b1a0-ff2bb065dc31]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:30 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9" returned: 0 in 0.302s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957b76e8-cfab-4738-a62c-d24b129439de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8623178b-3e2c-436d-8444-7943aaac90f9', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2beb25b9-79b0-406f-a6c8-8dadfe9e5381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:30 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD Nov 03 17:08:30 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:30 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Volume volume-8623178b-3e2c-436d-8444-7943aaac90f9 (8623178b-3e2c-436d-8444-7943aaac90f9): created successfully Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2beb25b9-79b0-406f-a6c8-8dadfe9e5381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Flow 'volume_create_manager' (e792d4d9-a207-4fa2-be90-777808e7d2e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-37767f25-1333-4f11-886f-dc734d453efd tempest-VolumesListAdminTestJSON-1734664432 None] Created volume successfully. Nov 03 17:08:30 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] 4d6008ab-d7f4-4403-8d44-c7c2165d2356 was qcow2, converting to qcow2 {{(pid=86661) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:30 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d Nov 03 17:08:30 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "cinder-98c7635b-7553-4d93-aff1-b1ae4f18d720-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-98c7635b-7553-4d93-aff1-b1ae4f18d720-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "cinder-quobyte-98c7635b-7553-4d93-aff1-b1ae4f18d720" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-quobyte-98c7635b-7553-4d93-aff1-b1ae4f18d720" acquired by "delete_volume" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:31 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c06da57-d52b-4f86-9eee-590a695e2e49]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:31 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720 Nov 03 17:08:31 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:31 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720" returned: 0 in 0.444s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:31 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720 Nov 03 17:08:31 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:31 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-98c7635b-7553-4d93-aff1-b1ae4f18d720" returned: 0 in 0.297s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-quobyte-98c7635b-7553-4d93-aff1-b1ae4f18d720" released by "delete_volume" :: held 0.803s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:31 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Created reservations ['3abc532f-6dd7-4614-b811-564a0c4a5e02', '57ba47be-58c9-4dad-ba0c-85fdd345feb4', 'a9355314-89e9-4066-b977-7dcdf8cbb75f', '4a065723-1bf8-4115-b958-644c108dffc6'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:32 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:32 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:32 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.392s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:32 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Deleted volume successfully. Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-578dc7f7-6832-4f3b-a74b-f72d98ad2c72 tempest-AttachVolumeNegativeTest-1504269075 None] Lock "cinder-98c7635b-7553-4d93-aff1-b1ae4f18d720-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Flow 'volume_create_manager' (13e8e2a4-dc60-48e7-84ba-f42a578e0283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd17a71-eff9-4101-8ea0-6789bbf2f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd17a71-eff9-4101-8ea0-6789bbf2f382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1deb1d9a-f25e-416c-b718-8c99ee4354ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c263acd7876a44d88d0899d17403678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:33Z,use_quota=True,user_id='2bb20dfda5c443c887d8e253c89d0838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd29fd92-8003-4286-89fd-e822b49e60f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd29fd92-8003-4286-89fd-e822b49e60f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1126b2e4-5748-4a26-a45b-989a720274fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1126b2e4-5748-4a26-a45b-989a720274fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1deb1d9a-f25e-416c-b718-8c99ee4354ff', 'volume_name': 'volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae313fb-a21c-4f6f-bfe3-33e7e4117ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae313fb-a21c-4f6f-bfe3-33e7e4117ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c81dce-ba8c-4698-a07d-1e9454ce12a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:32 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Volume 1deb1d9a-f25e-416c-b718-8c99ee4354ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff', 'volume_size': 1} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1deb1d9a-f25e-416c-b718-8c99ee4354ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c263acd7876a44d88d0899d17403678d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:33Z,use_quota=True,user_id='2bb20dfda5c443c887d8e253c89d0838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Creating volume 1deb1d9a-f25e-416c-b718-8c99ee4354ff {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:32 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:32 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff 1073741824 Nov 03 17:08:32 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:33 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d" returned: 0 in 2.558s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g20jl010devstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:08:33 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Converted 112.00 MB image at 43.75 MB/s Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:33 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d 1G Nov 03 17:08:33 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:33 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff 1073741824" returned: 0 in 0.627s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:33 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff Nov 03 17:08:33 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:33 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d 1G" returned: 0 in 0.463s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Downloaded image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}])) to volume 4733eb6e-f557-4e60-a7f0-fcad9686c13d successfully. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Temporary image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 for user 04accbf0743a49e186f44e11b02da6cf is deleted. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Marking volume 4733eb6e-f557-4e60-a7f0-fcad9686c13d as bootable. {{(pid=86661) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Copying metadata from image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 to 4733eb6e-f557-4e60-a7f0-fcad9686c13d. {{(pid=86661) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Creating volume glance metadata for volume 4733eb6e-f557-4e60-a7f0-fcad9686c13d backed by image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86661) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:08:33 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff" returned: 0 in 0.369s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c81dce-ba8c-4698-a07d-1e9454ce12a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd639891-69c5-44c4-89ce-bebd6b2f5f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:33 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Volume volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff (1deb1d9a-f25e-416c-b718-8c99ee4354ff): created successfully Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd639891-69c5-44c4-89ce-bebd6b2f5f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Flow 'volume_create_manager' (13e8e2a4-dc60-48e7-84ba-f42a578e0283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-389e96c0-6a04-4366-8b61-1aca8da40f7b tempest-VolumesListAdminTestJSON-1206776396 None] Created volume successfully. Nov 03 17:08:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefe1a1a-2bed-41b1-a6f4-012a9ef50829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b968aee2-7238-4fbc-a87d-79238e51d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:34 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Volume volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d (4733eb6e-f557-4e60-a7f0-fcad9686c13d): created successfully Nov 03 17:08:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b968aee2-7238-4fbc-a87d-79238e51d287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (13a433a8-5a94-4d23-9486-27d037ecc850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:34 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b82f0ae0-8c1a-43e0-8f7e-d9951b520934 tempest-VolumesGetTest-1425846753 None] Created volume successfully. Nov 03 17:08:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Acquiring lock "cinder-1deb1d9a-f25e-416c-b718-8c99ee4354ff-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Lock "cinder-1deb1d9a-f25e-416c-b718-8c99ee4354ff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Acquiring lock "cinder-quobyte-1deb1d9a-f25e-416c-b718-8c99ee4354ff" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Lock "cinder-quobyte-1deb1d9a-f25e-416c-b718-8c99ee4354ff" acquired by "delete_volume" :: waited 0.041s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[33208293-85d2-46ef-acb8-72c34cdb0d46]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "cinder-8623178b-3e2c-436d-8444-7943aaac90f9-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-8623178b-3e2c-436d-8444-7943aaac90f9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "cinder-quobyte-8623178b-3e2c-436d-8444-7943aaac90f9" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-quobyte-8623178b-3e2c-436d-8444-7943aaac90f9" acquired by "delete_volume" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:35 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff Nov 03 17:08:35 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8538fc0b-2102-4700-8f80-53a7dc857830]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:35 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9 Nov 03 17:08:35 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:35 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff" returned: 0 in 0.731s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:35 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff Nov 03 17:08:35 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (9aca0f75-0b17-4250-9552-4ddbe808aef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615b861a-b26c-49d7-9886-d83d85e24d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615b861a-b26c-49d7-9886-d83d85e24d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-971683557',display_name='tempest-VolumesGetTest-Volume-121363943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04069f97-f352-4bb9-a425-4835d9d58b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:36Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b842ec-5156-47d5-bab0-701be7676c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b842ec-5156-47d5-bab0-701be7676c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb577945-ea0c-43cb-816b-bd5fc82bab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb577945-ea0c-43cb-816b-bd5fc82bab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04069f97-f352-4bb9-a425-4835d9d58b5e', 'volume_name': 'volume-04069f97-f352-4bb9-a425-4835d9d58b5e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3cafe01-4b9d-4a36-86f4-a77ad11b0384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3cafe01-4b9d-4a36-86f4-a77ad11b0384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:35 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cfc77e0-ae00-4818-b4a4-5e96fa982b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:35 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Volume 04069f97-f352-4bb9-a425-4835d9d58b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04069f97-f352-4bb9-a425-4835d9d58b5e', 'volume_size': 1} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-971683557',display_name='tempest-VolumesGetTest-Volume-121363943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04069f97-f352-4bb9-a425-4835d9d58b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e999a2eb69e46f9ae2f72c845a8a84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:36Z,use_quota=True,user_id='04accbf0743a49e186f44e11b02da6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Creating volume 04069f97-f352-4bb9-a425-4835d9d58b5e {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:36 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9" returned: 0 in 0.597s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:36 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e 1073741824 Nov 03 17:08:36 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:36 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9 Nov 03 17:08:36 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:36 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1deb1d9a-f25e-416c-b718-8c99ee4354ff" returned: 0 in 0.347s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Lock "cinder-quobyte-1deb1d9a-f25e-416c-b718-8c99ee4354ff" released by "delete_volume" :: held 1.141s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Created reservations ['83b3a9e5-9ba9-48d1-8bed-45e1a5393572', '5289f754-3fd2-430e-9b59-e58224ea3fc8', '98c69c62-dc66-4322-a68e-eaab4edbf88a', '2348867d-247c-4e35-8f0b-5f1f8de91b31'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:36 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8623178b-3e2c-436d-8444-7943aaac90f9" returned: 0 in 0.312s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-quobyte-8623178b-3e2c-436d-8444-7943aaac90f9" released by "delete_volume" :: held 0.983s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:36 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:36 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Created reservations ['795aba61-b22e-4b33-b756-48cc095d1ad1', 'adeed13c-86a3-4987-8159-d494cb5bbcd7', '4afeef24-5aaa-40f5-9034-c91b6c1c5b59', '0838f096-f0ef-4533-98c7-4758ada53cfd'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:36 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:36 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:36 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e 1073741824" returned: 0 in 0.655s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:36 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e Nov 03 17:08:36 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:36 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.475s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Deleted volume successfully. Nov 03 17:08:36 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.353s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-87cf9b67-e132-4d4d-8a0d-dad0fe8f4441 tempest-VolumesListAdminTestJSON-1206776396 None] Lock "cinder-1deb1d9a-f25e-416c-b718-8c99ee4354ff-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Deleted volume successfully. Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-380a8c2f-449e-4f56-a9f7-0ae62ffeee99 tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-8623178b-3e2c-436d-8444-7943aaac90f9-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:37 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e" returned: 0 in 0.403s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cfc77e0-ae00-4818-b4a4-5e96fa982b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04069f97-f352-4bb9-a425-4835d9d58b5e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5225017c-32e3-4e78-8554-d33513ecd0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:37 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Volume volume-04069f97-f352-4bb9-a425-4835d9d58b5e (04069f97-f352-4bb9-a425-4835d9d58b5e): created successfully Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5225017c-32e3-4e78-8554-d33513ecd0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Flow 'volume_create_manager' (9aca0f75-0b17-4250-9552-4ddbe808aef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:37 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-218f7a2d-521f-435d-8702-0e0e9fabda97 tempest-VolumesGetTest-1425846753 None] Created volume successfully. Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "cinder-ea2219af-830f-4ad6-b973-231748e2de62-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-ea2219af-830f-4ad6-b973-231748e2de62-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "cinder-quobyte-ea2219af-830f-4ad6-b973-231748e2de62" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-quobyte-ea2219af-830f-4ad6-b973-231748e2de62" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f84876e-7e2d-45b5-8f23-af5005496ca6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:37 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62 Nov 03 17:08:37 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-04069f97-f352-4bb9-a425-4835d9d58b5e-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Lock "cinder-04069f97-f352-4bb9-a425-4835d9d58b5e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-quobyte-04069f97-f352-4bb9-a425-4835d9d58b5e" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-04069f97-f352-4bb9-a425-4835d9d58b5e" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da9a905-795c-4267-8287-931e0fcc8794]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:38 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62" returned: 0 in 0.623s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:38 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62 Nov 03 17:08:38 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:38 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e Nov 03 17:08:38 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:38 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ea2219af-830f-4ad6-b973-231748e2de62" returned: 0 in 0.305s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-quobyte-ea2219af-830f-4ad6-b973-231748e2de62" released by "delete_volume" :: held 0.983s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Created reservations ['3f3d8b52-08fd-4992-9d5d-416bdd1ca74a', '4926d094-e5f5-43f5-87df-55b0a70a55de', '69c9d1d4-37ab-4009-9240-7a11cf6d24e0', 'b36bef94-b647-4d4d-b2fd-8687b8dcb64f'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:38 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e" returned: 0 in 0.550s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:38 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e Nov 03 17:08:38 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:38 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:38 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:39 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-04069f97-f352-4bb9-a425-4835d9d58b5e" returned: 0 in 0.367s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:39 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-04069f97-f352-4bb9-a425-4835d9d58b5e" released by "delete_volume" :: held 0.976s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.321s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:39 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Deleted volume successfully. Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5b0a37f6-5e64-443b-9ae0-a34a585f4fbb tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-ea2219af-830f-4ad6-b973-231748e2de62-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Created reservations ['8fd5de9d-6e9a-4926-8d85-97f5098bf919', 'de023972-8a57-4b16-8ee8-70a7890114f8', 'c0a66eeb-93d4-4d8f-82e0-a437ccbe56f3', '8547622f-a682-4b95-8ac6-db445c6584a0'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:39 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:39 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:39 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.294s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:39 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Deleted volume successfully. Nov 03 17:08:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8cf35211-f618-413b-aa46-950d84f7b70c tempest-VolumesGetTest-1425846753 None] Lock "cinder-04069f97-f352-4bb9-a425-4835d9d58b5e-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "cinder-baa80c13-8c81-4c96-87d1-4569070b5cb8-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-baa80c13-8c81-4c96-87d1-4569070b5cb8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "cinder-quobyte-baa80c13-8c81-4c96-87d1-4569070b5cb8" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-quobyte-baa80c13-8c81-4c96-87d1-4569070b5cb8" acquired by "delete_volume" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c0bf44-8407-4b27-80d0-00e4716a7095]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:40 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8 Nov 03 17:08:40 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-4733eb6e-f557-4e60-a7f0-fcad9686c13d-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Lock "cinder-4733eb6e-f557-4e60-a7f0-fcad9686c13d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Acquiring lock "cinder-quobyte-4733eb6e-f557-4e60-a7f0-fcad9686c13d" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:08:40 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8" returned: 0 in 0.496s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-4733eb6e-f557-4e60-a7f0-fcad9686c13d" acquired by "delete_volume" :: waited 0.038s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:08:40 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8 Nov 03 17:08:40 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e959b5-ccab-43d6-b755-85cb0af4d157]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:40 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d Nov 03 17:08:40 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:41 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-baa80c13-8c81-4c96-87d1-4569070b5cb8" returned: 0 in 0.550s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-quobyte-baa80c13-8c81-4c96-87d1-4569070b5cb8" released by "delete_volume" :: held 1.116s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Created reservations ['2a776a3d-5759-456c-8a9a-87d6eccf94b7', '1e851070-24b4-413a-9929-23b6e894aeab', '045b0704-ecd0-4213-bba8-e5d2585ab631', '5b5152eb-6937-42b2-8138-0379a024b445'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:41 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d" returned: 0 in 0.606s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:41 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d Nov 03 17:08:41 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:41 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:41 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:41 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4733eb6e-f557-4e60-a7f0-fcad9686c13d" returned: 0 in 0.475s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:41 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.390s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Lock "cinder-quobyte-4733eb6e-f557-4e60-a7f0-fcad9686c13d" released by "delete_volume" :: held 1.155s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:41 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Deleted volume successfully. Nov 03 17:08:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9dc8729d-3695-49d4-8f8f-489bb41a29ab tempest-VolumesListAdminTestJSON-1734664432 None] Lock "cinder-baa80c13-8c81-4c96-87d1-4569070b5cb8-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:42 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Created reservations ['d6094f9e-8b98-4b19-a5d5-c20f0bc8f595', '54ab0f28-f4f7-4801-bd87-71f4ef779330', 'c433d622-8158-471c-8711-e8f6440086cb', '02ef067d-23b6-4664-834b-70903773c099'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:08:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:42 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:08:42 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:42 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.369s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:42 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:08:42 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Deleted volume successfully. Nov 03 17:08:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-893d162a-6472-4414-b9b9-d407dd2cfa6a tempest-VolumesGetTest-1425846753 None] Lock "cinder-4733eb6e-f557-4e60-a7f0-fcad9686c13d-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:08:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-37ea866b-218a-4b41-83d9-f84740abec39 tempest-BackendsCapabilitiesAdminTestsJSON-1224481667 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5803260803223, 'free_capacity_gb': 1773.5803260803223, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86661) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 17:08:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-01184361-d229-47a4-b470-e22fed8ee893 tempest-BackendsCapabilitiesAdminTestsJSON-1224481667 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5803260803223, 'free_capacity_gb': 1773.5803260803223, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86661) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Flow 'volume_create_manager' (987f7155-3455-46c1-af2d-f06cf2e07980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368b682f-12e7-404c-acdd-d5c3a9328a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368b682f-12e7-404c-acdd-d5c3a9328a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-817861282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac3acee-c86b-4e1e-be55-53489463cdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5250f946434256bb6a032cd0572005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:49Z,use_quota=True,user_id='52f504a3877b4226ae4fe8aecf38ba47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35799100-1c46-413c-b9cd-58185162e830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35799100-1c46-413c-b9cd-58185162e830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c10abf-ec6d-4c4d-9251-7442005acbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c10abf-ec6d-4c4d-9251-7442005acbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac3acee-c86b-4e1e-be55-53489463cdf8', 'volume_name': 'volume-0ac3acee-c86b-4e1e-be55-53489463cdf8', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fccb97-23b2-4ded-a9d0-646c748253f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fccb97-23b2-4ded-a9d0-646c748253f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79810125-8707-4005-967b-38bc493ecb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:48 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Volume 0ac3acee-c86b-4e1e-be55-53489463cdf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac3acee-c86b-4e1e-be55-53489463cdf8', 'volume_size': 1} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-817861282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac3acee-c86b-4e1e-be55-53489463cdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5250f946434256bb6a032cd0572005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:49Z,use_quota=True,user_id='52f504a3877b4226ae4fe8aecf38ba47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Creating volume 0ac3acee-c86b-4e1e-be55-53489463cdf8 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:48 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:48 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 1073741824 Nov 03 17:08:48 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:49 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 1073741824" returned: 0 in 0.773s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:49 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 Nov 03 17:08:49 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:50 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8" returned: 0 in 0.317s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79810125-8707-4005-967b-38bc493ecb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac3acee-c86b-4e1e-be55-53489463cdf8', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6f23b-322c-4ba1-afbe-6b7dcec628fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:50 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Volume volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 (0ac3acee-c86b-4e1e-be55-53489463cdf8): created successfully Nov 03 17:08:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6f23b-322c-4ba1-afbe-6b7dcec628fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Flow 'volume_create_manager' (987f7155-3455-46c1-af2d-f06cf2e07980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:50 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f947878a-6b78-4269-b99d-464ddc28c97c tempest-VolumesActionsTest-1170140135 None] Created volume successfully. Nov 03 17:08:52 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Flow 'volume_create_manager' (6d82cd9c-a646-4bce-8fcb-c80cfa1f7750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64265d98-b294-4c21-a9f5-dd8104734e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64265d98-b294-4c21-a9f5-dd8104734e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1468612060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7522e61c-587f-4243-a916-362ae4f1f42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8948ab56b15d4289b362815618e126fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:53Z,use_quota=True,user_id='8ec025e11e9b4698af2d20cd09c9b1c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff9f604-fc3a-46fe-9052-13dc8052a1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff9f604-fc3a-46fe-9052-13dc8052a1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bd7a80-8489-4681-8979-c253b031347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:52 devstack cinder-volume[86661]: DEBUG cinder.image.glance [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Creating Keystone auth plugin from conf {{(pid=86661) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:08:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7bd7a80-8489-4681-8979-c253b031347e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7522e61c-587f-4243-a916-362ae4f1f42a', 'volume_name': 'volume-7522e61c-587f-4243-a916-362ae4f1f42a', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f4ded8-e049-4ab0-9ed3-838dcfe808af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f4ded8-e049-4ab0-9ed3-838dcfe808af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7339a776-bbf6-4603-9e5e-0d4eac8fe8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:53 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Volume 7522e61c-587f-4243-a916-362ae4f1f42a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7522e61c-587f-4243-a916-362ae4f1f42a', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:08:53 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Trying to clone 7522e61c-587f-4243-a916-362ae4f1f42a from image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]). {{(pid=86661) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:08:54 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:08:54 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:08:54 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac1b960-c7dc-40d0-a8b7-b428345d5900]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:54 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD Nov 03 17:08:54 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:54 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:54 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Temporary image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 is fetched for user 8ec025e11e9b4698af2d20cd09c9b1c7. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:08:54 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[340a103d-8a06-4a30-8a67-22bddb1be66d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:55 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD Nov 03 17:08:55 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:55 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-91cc633c-6a72-4d8e-8b4c-f5eac65e6f51 tempest-GroupsV314Test-1759587274 None] Group tempest-GroupsV314Test-Group-221060723: creating Nov 03 17:08:55 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:55 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-91cc633c-6a72-4d8e-8b4c-f5eac65e6f51 tempest-GroupsV314Test-1759587274 None] Group tempest-GroupsV314Test-Group-221060723: created successfully Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1468612060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7522e61c-587f-4243-a916-362ae4f1f42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8948ab56b15d4289b362815618e126fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:53Z,use_quota=True,user_id='8ec025e11e9b4698af2d20cd09c9b1c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Creating volume 7522e61c-587f-4243-a916-362ae4f1f42a {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:55 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:55 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-91cc633c-6a72-4d8e-8b4c-f5eac65e6f51 tempest-GroupsV314Test-1759587274 None] Create group completed successfully. Nov 03 17:08:55 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a 1073741824 Nov 03 17:08:55 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:55 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a 1073741824" returned: 0 in 0.638s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:56 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a Nov 03 17:08:56 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:56 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a" returned: 0 in 0.326s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:56 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Attempting download of 4d6008ab-d7f4-4403-8d44-c7c2165d2356 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}])) to volume 7522e61c-587f-4243-a916-362ae4f1f42a. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:08:56 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b01bcf-578b-46f0-9993-4de6616c4775]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_owgwpbza {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:56 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_owgwpbza Nov 03 17:08:56 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:56 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_owgwpbza" returned: 0 in 0.492s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_owgwpbza {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:57 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_owgwpbza Nov 03 17:08:57 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Flow 'volume_create_manager' (f4552200-4775-4117-acd4-b132caedad9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8bd69e-4a9f-468b-ab42-7169d95d032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8bd69e-4a9f-468b-ab42-7169d95d032d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-816492619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22d26ccb-d3ed-4495-942b-4cd574b0a71e,host='devstack@QuobyteHD#QuobyteHD',id=32b50163-b01b-4670-9816-37662ec8ee82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6250bc22a26044fdb7b6a7fe87334bf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:57Z,use_quota=True,user_id='b6572008374740a9a3c56c432769743c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8453c37e-4498-4fe1-a5fb-707a76f906d5),volume_type_id=8453c37e-4498-4fe1-a5fb-707a76f906d5)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2846a78a-7207-440b-8784-2c3700079f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2846a78a-7207-440b-8784-2c3700079f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e15bf9-81eb-4ebd-b71f-177c58bc654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e15bf9-81eb-4ebd-b71f-177c58bc654d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b50163-b01b-4670-9816-37662ec8ee82', 'volume_name': 'volume-32b50163-b01b-4670-9816-37662ec8ee82', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d5ab84-162f-4ed8-bcb9-2c81c987c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d5ab84-162f-4ed8-bcb9-2c81c987c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb904333-bb83-4d1e-a299-61d09270d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:57 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Volume 32b50163-b01b-4670-9816-37662ec8ee82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b50163-b01b-4670-9816-37662ec8ee82', 'volume_size': 1} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22d26ccb-d3ed-4495-942b-4cd574b0a71e,created_at=2026-11-03T16:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-816492619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22d26ccb-d3ed-4495-942b-4cd574b0a71e,host='devstack@QuobyteHD#QuobyteHD',id=32b50163-b01b-4670-9816-37662ec8ee82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6250bc22a26044fdb7b6a7fe87334bf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:08:57Z,use_quota=True,user_id='b6572008374740a9a3c56c432769743c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8453c37e-4498-4fe1-a5fb-707a76f906d5),volume_type_id=8453c37e-4498-4fe1-a5fb-707a76f906d5)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Creating volume 32b50163-b01b-4670-9816-37662ec8ee82 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:08:57 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:57 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 1073741824 Nov 03 17:08:57 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:57 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_owgwpbza" returned: 1 in 0.529s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_owgwpbza' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c93e0a-7568-4d90-824e-87c16fb65be0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:57 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD Nov 03 17:08:57 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:57 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] 4d6008ab-d7f4-4403-8d44-c7c2165d2356 was qcow2, converting to qcow2 {{(pid=86661) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:08:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:58 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a Nov 03 17:08:58 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:58 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 1073741824" returned: 0 in 0.705s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:08:58 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 Nov 03 17:08:58 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:08:58 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Nov 03 17:08:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82" returned: 0 in 0.360s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:08:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:08:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:08:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb904333-bb83-4d1e-a299-61d09270d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b50163-b01b-4670-9816-37662ec8ee82', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46fa9c0d-abfe-4292-ac56-4220d0b7b9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:08:58 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Volume volume-32b50163-b01b-4670-9816-37662ec8ee82 (32b50163-b01b-4670-9816-37662ec8ee82): created successfully Nov 03 17:08:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46fa9c0d-abfe-4292-ac56-4220d0b7b9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:08:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Flow 'volume_create_manager' (f4552200-4775-4117-acd4-b132caedad9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:08:58 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5f6e482d-3938-44d4-b6c2-61acbcfc398f tempest-GroupsV314Test-1759587274 None] Created volume successfully. Nov 03 17:09:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:01 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Cloning volume 32b50163-b01b-4670-9816-37662ec8ee82 to volume 8afadb7c-5361-4167-8387-6e453eb3b037 Nov 03 17:09:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Creating offline snapshot f6b1d6ee-c76e-49e8-a342-3ba26068bdbf of volume 32b50163-b01b-4670-9816-37662ec8ee82 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:09:01 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1df3de-7018-4152-95b9-f4b0714590d6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:01 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a" returned: 0 in 3.622s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:01 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_w68dftdzdevstack@QuobyteHD, size 112.00 MB, duration 3.63 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:09:01 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Converted 112.00 MB image at 30.89 MB/s Nov 03 17:09:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:01 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 Nov 03 17:09:01 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:01 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a 1G Nov 03 17:09:01 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:02 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82" returned: 0 in 0.659s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:02 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf 1G Nov 03 17:09:02 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:02 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a 1G" returned: 0 in 0.642s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Downloaded image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}])) to volume 7522e61c-587f-4243-a916-362ae4f1f42a successfully. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Temporary image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 for user 8ec025e11e9b4698af2d20cd09c9b1c7 is deleted. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Marking volume 7522e61c-587f-4243-a916-362ae4f1f42a as bootable. {{(pid=86661) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Copying metadata from image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 to 7522e61c-587f-4243-a916-362ae4f1f42a. {{(pid=86661) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Creating volume glance metadata for volume 7522e61c-587f-4243-a916-362ae4f1f42a backed by image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86661) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7339a776-bbf6-4603-9e5e-0d4eac8fe8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7522e61c-587f-4243-a916-362ae4f1f42a', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5e4acb-2246-4f1f-a2fa-e21b7c639527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:02 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Volume volume-7522e61c-587f-4243-a916-362ae4f1f42a (7522e61c-587f-4243-a916-362ae4f1f42a): created successfully Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5e4acb-2246-4f1f-a2fa-e21b7c639527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Flow 'volume_create_manager' (6d82cd9c-a646-4bce-8fcb-c80cfa1f7750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-46ed492a-d762-4e9c-b855-e918afa99b5b tempest-VolumesImageMetadata-625823234 None] Created volume successfully. Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-de00c8f7-4723-4141-b8ec-ee358e527a03 tempest-VolumesActionsTest-1170140135 None] Acquiring lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8" by "attach_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-de00c8f7-4723-4141-b8ec-ee358e527a03 tempest-VolumesActionsTest-1170140135 None] Lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8" acquired by "attach_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-de00c8f7-4723-4141-b8ec-ee358e527a03 tempest-VolumesActionsTest-1170140135 None] Attaching volume 0ac3acee-c86b-4e1e-be55-53489463cdf8 to instance f77de0ea-29ae-49ef-8a90-86e65f70e6ac at mountpoint /dev/vdb on host None. Nov 03 17:09:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-de00c8f7-4723-4141-b8ec-ee358e527a03 tempest-VolumesActionsTest-1170140135 None] Attach volume completed successfully. Nov 03 17:09:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-de00c8f7-4723-4141-b8ec-ee358e527a03 tempest-VolumesActionsTest-1170140135 None] Lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8" released by "attach_volume" :: held 0.124s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:03 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf 1G" returned: 0 in 0.983s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b50163-b01b-4670-9816-37662ec8ee82 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:03 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b50163-b01b-4670-9816-37662ec8ee82 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf Nov 03 17:09:03 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2ba02c64-3458-4a0b-93db-fce1f67c41b8 tempest-VolumesActionsTest-1170140135 None] Acquiring lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8-detach_volume" by "detach_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2ba02c64-3458-4a0b-93db-fce1f67c41b8 tempest-VolumesActionsTest-1170140135 None] Lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:03 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2ba02c64-3458-4a0b-93db-fce1f67c41b8 tempest-VolumesActionsTest-1170140135 None] Detaching volume 0ac3acee-c86b-4e1e-be55-53489463cdf8 from instance f77de0ea-29ae-49ef-8a90-86e65f70e6ac. Nov 03 17:09:03 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2ba02c64-3458-4a0b-93db-fce1f67c41b8 tempest-VolumesActionsTest-1170140135 None] Detach volume completed successfully. Nov 03 17:09:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2ba02c64-3458-4a0b-93db-fce1f67c41b8 tempest-VolumesActionsTest-1170140135 None] Lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:03 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32b50163-b01b-4670-9816-37662ec8ee82 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf" returned: 0 in 0.448s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:03 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:09:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:03 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf Nov 03 17:09:03 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:04 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf" returned: 0 in 0.619s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:04 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.info Nov 03 17:09:04 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:04 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.info" returned: 0 in 0.707s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:04 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:09:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:05 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.info Nov 03 17:09:05 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Acquiring lock "cinder-7522e61c-587f-4243-a916-362ae4f1f42a-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Lock "cinder-7522e61c-587f-4243-a916-362ae4f1f42a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Acquiring lock "cinder-quobyte-7522e61c-587f-4243-a916-362ae4f1f42a" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Lock "cinder-quobyte-7522e61c-587f-4243-a916-362ae4f1f42a" acquired by "delete_volume" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f26f4ef-7e51-46c3-9088-8e320da6f1e6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:05 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.info" returned: 0 in 0.488s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Acquiring lock "cinder-quobyte-8afadb7c-5361-4167-8387-6e453eb3b037" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:05 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a Nov 03 17:09:05 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Lock "cinder-quobyte-8afadb7c-5361-4167-8387-6e453eb3b037" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] snapshot: f6b1d6ee-c76e-49e8-a342-3ba26068bdbf, volume: 8afadb7c-5361-4167-8387-6e453eb3b037, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe69c475-0c31-4251-8e3f-9a972dd63139]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:05 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf Nov 03 17:09:05 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:05 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a" returned: 0 in 0.581s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:05 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a Nov 03 17:09:05 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:06 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf" returned: 0 in 0.516s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b50163-b01b-4670-9816-37662ec8ee82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[65160398-462b-420d-85d4-6ffbc349cbc9]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:06 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 Nov 03 17:09:06 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:06 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7522e61c-587f-4243-a916-362ae4f1f42a" returned: 0 in 0.481s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Lock "cinder-quobyte-7522e61c-587f-4243-a916-362ae4f1f42a" released by "delete_volume" :: held 1.149s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Created reservations ['bb56edec-4724-4d01-9302-a1c452fab6fc', '942f34c9-1382-4ba5-bd49-b8d329e78ac4', '0bf895ba-fc49-40e6-b8ff-2596eb58229c', 'fddbcbe7-a60c-4726-a57e-3643940ba1ff'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:06 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:09:06 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:06 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82" returned: 0 in 0.699s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037 not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:09:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:06 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037 Nov 03 17:09:06 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:07 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.540s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:07 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:07 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Deleted volume successfully. Nov 03 17:09:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6c0e3770-1676-46c1-b41a-864916232376 tempest-VolumesImageMetadata-625823234 None] Lock "cinder-7522e61c-587f-4243-a916-362ae4f1f42a-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:16 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=176,cinder:SELECT=133,cinder:INSERT=54,cinder:DELETE=13 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=164,cinder:SELECT=141,cinder:INSERT=50,cinder:DELETE=16 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:09:17 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037" returned: 0 in 10.475s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82, size 1024.00 MB, duration 10.48 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037 {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:09:17 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Converted 1024.00 MB image at 97.74 MB/s Nov 03 17:09:17 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:17 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037 Nov 03 17:09:17 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:17 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037" returned: 0 in 0.484s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Lock "cinder-quobyte-8afadb7c-5361-4167-8387-6e453eb3b037" released by "_copy_volume_from_snapshot" :: held 12.316s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Acquiring lock "cinder-quobyte-f6b1d6ee-c76e-49e8-a342-3ba26068bdbf" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Lock "cinder-quobyte-f6b1d6ee-c76e-49e8-a342-3ba26068bdbf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Deleting offline snapshot f6b1d6ee-c76e-49e8-a342-3ba26068bdbf of volume 32b50163-b01b-4670-9816-37662ec8ee82 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] snapshot_file for this snap is: volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5af6d6-1739-48ba-b5ac-5e33d7d9e5b5]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:18 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf Nov 03 17:09:18 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:18 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf" returned: 0 in 0.546s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32b50163-b01b-4670-9816-37662ec8ee82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[169e5e00-37bc-4ddd-b44e-67bfb3618670]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Flow 'volume_create_manager' (25045dec-2a3a-43ad-8274-c2a972fea50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:18 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 Nov 03 17:09:18 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce45424d-f0a2-4bda-bb31-52fe7b1385d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce45424d-f0a2-4bda-bb31-52fe7b1385d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1262865367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1637a655f64a9e8c6236181f22e30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:19Z,use_quota=True,user_id='3d7adcff13dc45d9b3a140f02a721e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494a8a8a-a11a-4bc4-9cd9-08b4ef5672c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494a8a8a-a11a-4bc4-9cd9-08b4ef5672c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c4a744-9781-48ab-8ba0-cd28f857c20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c4a744-9781-48ab-8ba0-cd28f857c20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b', 'volume_name': 'volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8cf4096-d3cc-47f0-9c63-f995bff9384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8cf4096-d3cc-47f0-9c63-f995bff9384e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42e9ec6-cf93-44a9-8ae1-95a32bcbf931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:18 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Volume bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b', 'volume_size': 1} Nov 03 17:09:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:19 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82" returned: 0 in 0.628s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:19 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf Nov 03 17:09:19 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:19 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf" returned: 0 in 0.426s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:19 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf Nov 03 17:09:19 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:19 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82.f6b1d6ee-c76e-49e8-a342-3ba26068bdbf" returned: 0 in 0.307s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Lock "cinder-quobyte-f6b1d6ee-c76e-49e8-a342-3ba26068bdbf" released by "_delete_snapshot" :: held 2.068s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.693s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1262865367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1637a655f64a9e8c6236181f22e30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:19Z,use_quota=True,user_id='3d7adcff13dc45d9b3a140f02a721e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Creating volume bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:09:20 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:20 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b 1073741824 Nov 03 17:09:20 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:20 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-650ed1fe-28c2-46ae-9320-cf9a08eed4cf tempest-GroupsV314Test-1759587274 None] Create group from source-group-22d26ccb-d3ed-4495-942b-4cd574b0a71e completed successfully. Nov 03 17:09:20 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b 1073741824" returned: 0 in 0.614s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:20 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b Nov 03 17:09:20 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:21 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" returned: 0 in 0.327s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:09:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42e9ec6-cf93-44a9-8ae1-95a32bcbf931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baabb3ab-ba03-4392-b6e6-69b5dd400913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:21 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Volume volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b (bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b): created successfully Nov 03 17:09:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baabb3ab-ba03-4392-b6e6-69b5dd400913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Flow 'volume_create_manager' (25045dec-2a3a-43ad-8274-c2a972fea50f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-67d1eff7-093c-4844-beb1-c57da2b94739 tempest-VolumesDeleteCascade-1118704357 None] Created volume successfully. Nov 03 17:09:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] Creating offline snapshot d803439d-2471-49bc-8129-c9c289593a61 of volume bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:09:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Acquiring lock "cinder-quobyte-8afadb7c-5361-4167-8387-6e453eb3b037" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:22 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8d26bb-1236-4b7a-a4c3-eabb612ae11f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Lock "cinder-quobyte-8afadb7c-5361-4167-8387-6e453eb3b037" acquired by "delete_volume" :: waited 0.082s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:22 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e000c4-55bd-43ab-a1ed-d5d91fda4cb5]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:22 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b Nov 03 17:09:22 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:22 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037 Nov 03 17:09:22 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:23 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037" returned: 0 in 0.736s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:23 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" returned: 0 in 0.903s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:23 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037 Nov 03 17:09:23 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:23 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 1G Nov 03 17:09:23 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:23 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8afadb7c-5361-4167-8387-6e453eb3b037" returned: 0 in 0.438s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Lock "cinder-quobyte-8afadb7c-5361-4167-8387-6e453eb3b037" released by "delete_volume" :: held 1.310s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Created reservations ['fd43befc-e43c-46dd-b6f2-f9354fcb596b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:24 devstack cinder-volume[86661]: WARNING cinder.quota [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-706526165 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-706526165, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:09:24 devstack cinder-volume[86661]: WARNING cinder.quota [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-706526165 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-706526165, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Created reservations ['a1e651b6-d18b-4de2-87d1-97bc80593964', 'a1b00ad0-e61c-4f3e-a56b-05a4bf4a8198', 'b3e3bd8d-4a9e-4775-acbc-7a2df2f79be0', '849cdd8d-21b4-44df-918f-e44a63d6587b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:24 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-490f00b1-875e-4ad0-a55f-889d19043b4e tempest-VolumesActionsTest-1170140135 None] Acquiring lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8" by "attach_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 1G" returned: 0 in 0.975s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-490f00b1-875e-4ad0-a55f-889d19043b4e tempest-VolumesActionsTest-1170140135 None] Lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8" acquired by "attach_volume" :: waited 0.060s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:24 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 Nov 03 17:09:24 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-490f00b1-875e-4ad0-a55f-889d19043b4e tempest-VolumesActionsTest-1170140135 None] Attaching volume 0ac3acee-c86b-4e1e-be55-53489463cdf8 to instance 4a48a286-9fe2-4eb3-9f53-e1240a9456a6 at mountpoint /dev/vdb on host None. Nov 03 17:09:24 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:09:24 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-490f00b1-875e-4ad0-a55f-889d19043b4e tempest-VolumesActionsTest-1170140135 None] Attach volume completed successfully. Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-490f00b1-875e-4ad0-a55f-889d19043b4e tempest-VolumesActionsTest-1170140135 None] Lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8" released by "attach_volume" :: held 0.190s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:24 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.416s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-18fa96fc-8d7c-4266-b8ec-de7b6c3f38e7 tempest-GroupsV314Test-1759587274 None] Delete group completed successfully. Nov 03 17:09:24 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61" returned: 0 in 0.600s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:24 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 is being set with open permissions: ugo+rw Nov 03 17:09:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:25 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 Nov 03 17:09:25 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:25 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61" returned: 0 in 0.537s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-20bd93df-5359-4968-b37a-5d7b41337dec tempest-VolumesActionsTest-1170140135 None] Acquiring lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8-detach_volume" by "detach_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Acquiring lock "cinder-quobyte-32b50163-b01b-4670-9816-37662ec8ee82" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-20bd93df-5359-4968-b37a-5d7b41337dec tempest-VolumesActionsTest-1170140135 None] Lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8-detach_volume" acquired by "detach_volume" :: waited 0.078s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-20bd93df-5359-4968-b37a-5d7b41337dec tempest-VolumesActionsTest-1170140135 None] Detaching volume 0ac3acee-c86b-4e1e-be55-53489463cdf8 from instance 4a48a286-9fe2-4eb3-9f53-e1240a9456a6. Nov 03 17:09:25 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.info Nov 03 17:09:25 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Lock "cinder-quobyte-32b50163-b01b-4670-9816-37662ec8ee82" acquired by "delete_volume" :: waited 0.083s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:25 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3aef3e-ea06-4caa-a6d9-f8597683cc82]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-20bd93df-5359-4968-b37a-5d7b41337dec tempest-VolumesActionsTest-1170140135 None] Detach volume completed successfully. Nov 03 17:09:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-20bd93df-5359-4968-b37a-5d7b41337dec tempest-VolumesActionsTest-1170140135 None] Lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8-detach_volume" released by "detach_volume" :: held 0.259s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:26 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 Nov 03 17:09:26 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:26 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.info" returned: 0 in 0.388s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:26 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.info is being set with open permissions: ugo+rw Nov 03 17:09:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:26 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.info Nov 03 17:09:26 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:26 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82" returned: 0 in 0.665s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:26 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82 Nov 03 17:09:26 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:26 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.info" returned: 0 in 0.571s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.315s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:26 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f368a354-34ed-4bfe-865a-16f7d478aac1 tempest-VolumesDeleteCascade-1118704357 None] Create snapshot completed successfully Nov 03 17:09:26 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-32b50163-b01b-4670-9816-37662ec8ee82" returned: 0 in 0.452s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Lock "cinder-quobyte-32b50163-b01b-4670-9816-37662ec8ee82" released by "delete_volume" :: held 1.247s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:27 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Created reservations ['c25859a8-207c-4505-8906-48bfd3bd0daf'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:27 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Created reservations ['cb2742f6-4ce8-4b6e-a61e-5ee3975ba039', '7e183cd3-8a39-4b93-ab0f-e215077bab2d', 'a11f2196-226e-42f8-812d-131779013377', '4a3d3f95-45d8-462e-a982-c3da3985aa88'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:27 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:09:27 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:27 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.357s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:27 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-fc1ff405-ebee-495f-813b-8ce7b80d65c7 tempest-GroupsV314Test-1759587274 None] Delete group completed successfully. Nov 03 17:09:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] Creating offline snapshot 17e342fc-9397-4aed-b17b-e18cc7b86fd1 of volume bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:09:28 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[78045246-68ae-4799-a7a3-b0933d238368]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:28 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 Nov 03 17:09:28 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:28 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61" returned: 0 in 0.712s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:09:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:28 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 1G Nov 03 17:09:28 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:29 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 1G" returned: 0 in 0.684s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:29 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 Nov 03 17:09:29 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:09:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:29 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:09:29 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:30 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1" returned: 0 in 0.498s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:30 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 is being set with open permissions: ugo+rw Nov 03 17:09:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:30 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 Nov 03 17:09:30 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:30 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.421s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:09:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:09:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:09:30 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1" returned: 0 in 0.407s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.510s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6294ccbc-4362-487d-9510-6d8088567eb0 tempest-VolumesDeleteCascade-1118704357 None] Create snapshot completed successfully Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Performing cascade delete. {{(pid=86661) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-17e342fc-9397-4aed-b17b-e18cc7b86fd1-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-17e342fc-9397-4aed-b17b-e18cc7b86fd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-quobyte-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-quobyte-17e342fc-9397-4aed-b17b-e18cc7b86fd1" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-17e342fc-9397-4aed-b17b-e18cc7b86fd1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Deleting offline snapshot 17e342fc-9397-4aed-b17b-e18cc7b86fd1 of volume bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] snapshot_file for this snap is: volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bd90ad-17c5-49c4-b7d3-3f9cc2ee99a0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:31 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 Nov 03 17:09:31 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e818ed-3143-4280-8079-097b5c1ffdd4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:32 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 Nov 03 17:09:32 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:32 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1" returned: 0 in 0.551s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:09:32 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f5256e-9b84-43d3-a2ba-9c521e5fc02e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:32 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 Nov 03 17:09:32 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:32 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8" returned: 0 in 0.479s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:32 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f40237d-73c9-4774-99a4-dbc946cba27f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:32 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 Nov 03 17:09:32 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:32 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61" returned: 0 in 0.593s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:09:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:32 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 Nov 03 17:09:32 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:33 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8" returned: 0 in 0.622s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.13a698a5-f921-4f8b-9ecf-a9564b4e92bepx_040n5.img {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:33 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.13a698a5-f921-4f8b-9ecf-a9564b4e92bepx_040n5.img Nov 03 17:09:33 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:33 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1" returned: 0 in 0.618s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:33 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1 Nov 03 17:09:33 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:33 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.17e342fc-9397-4aed-b17b-e18cc7b86fd1" returned: 0 in 0.590s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-17e342fc-9397-4aed-b17b-e18cc7b86fd1" released by "_delete_snapshot" :: held 2.579s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" released by "delete_snapshot" :: held 2.633s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Created reservations ['f14ded30-b05f-4082-8dad-34ecc49fdd22', '57fa9476-ab17-48a5-93cb-d00125097f8b', 'd6d46520-e0d4-4490-a9df-0894c936c469', '991a4469-adc4-4a18-baf5-29ee3b45466f'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:34 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Delete snapshot completed successfully. Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-17e342fc-9397-4aed-b17b-e18cc7b86fd1-delete_snapshot" released by "delete_snapshot" :: held 3.118s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-d803439d-2471-49bc-8129-c9c289593a61-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-d803439d-2471-49bc-8129-c9c289593a61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-quobyte-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-quobyte-d803439d-2471-49bc-8129-c9c289593a61" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-d803439d-2471-49bc-8129-c9c289593a61" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Deleting offline snapshot d803439d-2471-49bc-8129-c9c289593a61 of volume bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] snapshot_file for this snap is: volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[df87ed0a-e471-41c5-9448-c549b966b923]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:35 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 Nov 03 17:09:35 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:35 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61" returned: 0 in 0.887s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:09:35 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ea4d9e-253d-4bc0-93a3-58c1f39f625b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:36 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b Nov 03 17:09:36 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:36 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" returned: 0 in 0.900s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:36 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 Nov 03 17:09:36 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:37 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61" returned: 0 in 0.707s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:37 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61 Nov 03 17:09:37 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:38 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b.d803439d-2471-49bc-8129-c9c289593a61" returned: 0 in 0.616s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-d803439d-2471-49bc-8129-c9c289593a61" released by "_delete_snapshot" :: held 3.416s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" released by "delete_snapshot" :: held 3.479s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:38 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Created reservations ['af3f8f97-03a0-4401-ab0f-7d7b62fc97c9', '3c9e8963-eec9-4eb5-882b-c6aa2de374ee', '47e54751-fac4-41d4-a025-c739119223a7', '9f358faf-67da-4573-9d69-8bfdf2320757'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:38 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Delete snapshot completed successfully. Nov 03 17:09:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-d803439d-2471-49bc-8129-c9c289593a61-delete_snapshot" released by "delete_snapshot" :: held 3.890s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Snapshots deleted, issuing volume delete {{(pid=86661) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 17:09:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-quobyte-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:09:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" acquired by "delete_volume" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:09:38 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6feb5ed-8e85-422d-b36a-fa7fc2425f1b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:38 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b Nov 03 17:09:38 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:39 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" returned: 0 in 0.735s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:39 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b Nov 03 17:09:39 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:39 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" returned: 0 in 0.501s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b" released by "delete_volume" :: held 1.421s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:40 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Created reservations ['5b70c494-3a2f-42b3-8bdb-9666d55f75dc', 'f457e8d1-a096-4b9b-90c2-5226e564222f', 'c3600aaf-c056-4438-9abb-a1b91ab4f4c7', 'afe922a8-a5a5-4a6d-8e45-1b716000d0c9'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:40 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:09:40 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:40 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.651s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:40 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:40 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Deleted volume successfully. Nov 03 17:09:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3bf3216a-81d0-4a48-a669-279e9bda6748 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-bbc4ba70-6f64-4cb2-bc23-39ad147b5c6b-delete_volume" released by "delete_volume" :: held 9.591s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:09:41 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.13a698a5-f921-4f8b-9ecf-a9564b4e92bepx_040n5.img" returned: 0 in 8.727s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:41 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe455d-212e-4d79-8657-8117ee4d7be1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:09:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:41 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 Nov 03 17:09:41 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:42 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-540ca9d6-1e2d-4ebd-aa16-302a5fa30b57 tempest-GroupsV320Test-859128823 None] Group tempest-GroupsV320Test-Group-463233703: creating Nov 03 17:09:42 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-540ca9d6-1e2d-4ebd-aa16-302a5fa30b57 tempest-GroupsV320Test-859128823 None] Group tempest-GroupsV320Test-Group-463233703: created successfully Nov 03 17:09:42 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-540ca9d6-1e2d-4ebd-aa16-302a5fa30b57 tempest-GroupsV320Test-859128823 None] Create group completed successfully. Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Flow 'volume_create_manager' (3f63463e-bf72-4287-afd7-3befd2326bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d21cf0-8289-49b6-a540-f929e4226846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d21cf0-8289-49b6-a540-f929e4226846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1435082956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19cd897-8c26-4ddb-935e-eb12991e5d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1637a655f64a9e8c6236181f22e30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:42Z,use_quota=True,user_id='3d7adcff13dc45d9b3a140f02a721e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c096a45-ea98-45ba-b179-d241a7ee51d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c096a45-ea98-45ba-b179-d241a7ee51d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04329cdd-a5da-4d4c-92b4-623bed090e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04329cdd-a5da-4d4c-92b4-623bed090e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b19cd897-8c26-4ddb-935e-eb12991e5d2b', 'volume_name': 'volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b738ebe-2af0-4f57-b91a-69e92e41eb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b738ebe-2af0-4f57-b91a-69e92e41eb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681ec861-05d3-4942-9460-c872261fd7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:42 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Volume b19cd897-8c26-4ddb-935e-eb12991e5d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b', 'volume_size': 1} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:42 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8" returned: 0 in 0.740s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.13a698a5-f921-4f8b-9ecf-a9564b4e92bepx_040n5.img {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:09:42 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] Converted 1024.00 MB image at 117.33 MB/s Nov 03 17:09:42 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] 13a698a5-f921-4f8b-9ecf-a9564b4e92be was raw, no need to convert to raw {{(pid=86661) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 17:09:43 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-cad9e907-9bd4-49f4-a69b-7866aecd519d tempest-GroupsV320Test-859128823 None] Created reservations ['1e555bd8-2351-4b30-aaf1-58cf13daab6d'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:09:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cad9e907-9bd4-49f4-a69b-7866aecd519d tempest-GroupsV320Test-859128823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cad9e907-9bd4-49f4-a69b-7866aecd519d tempest-GroupsV320Test-859128823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:09:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cad9e907-9bd4-49f4-a69b-7866aecd519d tempest-GroupsV320Test-859128823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:09:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cad9e907-9bd4-49f4-a69b-7866aecd519d tempest-GroupsV320Test-859128823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:09:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cad9e907-9bd4-49f4-a69b-7866aecd519d tempest-GroupsV320Test-859128823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:09:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cad9e907-9bd4-49f4-a69b-7866aecd519d tempest-GroupsV320Test-859128823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:09:43 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:09:43 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:09:44 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Nov 03 17:09:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cad9e907-9bd4-49f4-a69b-7866aecd519d tempest-GroupsV320Test-859128823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.595s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:09:44 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-cad9e907-9bd4-49f4-a69b-7866aecd519d tempest-GroupsV320Test-859128823 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:09:44 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-cad9e907-9bd4-49f4-a69b-7866aecd519d tempest-GroupsV320Test-859128823 None] Delete group completed successfully. Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Flow 'volume_create_manager' (8fdd48eb-0a26-4205-982e-3ade77ea1179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fec2dc-69f3-4aad-9ec9-3df97d3db86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fec2dc-69f3-4aad-9ec9-3df97d3db86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-458270916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2d8485-c751-4e1b-ab85-960cd03bd89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141566cc75f4cf1a9db3573ba355302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:52Z,use_quota=True,user_id='f1fa3b18a8a949f6a4b6a6c79f778348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a993ea42-ab08-462b-8753-4fdd6a488c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a993ea42-ab08-462b-8753-4fdd6a488c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86608e6-e13c-4307-8ce1-b4a3549aed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86608e6-e13c-4307-8ce1-b4a3549aed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2d8485-c751-4e1b-ab85-960cd03bd89c', 'volume_name': 'volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64880e2-7f5d-4b55-a908-e7a306953472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64880e2-7f5d-4b55-a908-e7a306953472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64af736e-74c9-4afe-92e5-ed07b8d7f9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:52 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Volume ef2d8485-c751-4e1b-ab85-960cd03bd89c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c', 'volume_size': 1} Nov 03 17:09:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Flow 'volume_create_manager' (dffea338-c0d9-4f9d-8796-df87ca0a13cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a99507a-8b10-4b6b-b0c5-5de548ce73b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a99507a-8b10-4b6b-b0c5-5de548ce73b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1594218938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8784d8d5-0bbc-44ac-a002-d7a30b39077d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6325463cf94308823bb27353d36524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:56Z,use_quota=True,user_id='895e418ded25452483cf35a49c80aa7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d30291-3a06-4d80-872d-fdd93acacbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d30291-3a06-4d80-872d-fdd93acacbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5bea0b-b1e1-42e6-a5b1-83d23c7c49a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5bea0b-b1e1-42e6-a5b1-83d23c7c49a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8784d8d5-0bbc-44ac-a002-d7a30b39077d', 'volume_name': 'volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cb63e7-2fe0-4bc6-8f7d-d1adabec7488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cb63e7-2fe0-4bc6-8f7d-d1adabec7488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a1669f-85ba-489a-a9e2-5c21be20c114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:09:55 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d', 'volume_size': 1} Nov 03 17:09:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:05 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=60,cinder:SELECT=57,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:10:05 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=61,cinder:UPDATE=54,cinder:INSERT=18,cinder:DELETE=3 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.028s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] Uploaded volume to glance image-id: 13a698a5-f921-4f8b-9ecf-a9564b4e92be. {{(pid=86661) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.470s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1435082956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19cd897-8c26-4ddb-935e-eb12991e5d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1637a655f64a9e8c6236181f22e30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:42Z,use_quota=True,user_id='3d7adcff13dc45d9b3a140f02a721e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Creating volume b19cd897-8c26-4ddb-935e-eb12991e5d2b {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:07 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:10:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:07 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b 1073741824 Nov 03 17:10:07 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:07 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6977bd1e-79ea-43ba-bce7-0e377de64f9f tempest-VolumesActionsTest-1170140135 None] Copy volume to image completed successfully. Nov 03 17:10:08 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b 1073741824" returned: 0 in 0.546s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:08 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b Nov 03 17:10:08 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:08 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b" returned: 0 in 0.305s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.431s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-458270916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2d8485-c751-4e1b-ab85-960cd03bd89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141566cc75f4cf1a9db3573ba355302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:52Z,use_quota=True,user_id='f1fa3b18a8a949f6a4b6a6c79f778348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Creating volume ef2d8485-c751-4e1b-ab85-960cd03bd89c {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:08 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:08 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c 1073741824 Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681ec861-05d3-4942-9460-c872261fd7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:08 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e8ebba-ae9e-4431-941b-9168157842d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:08 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Volume volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b (b19cd897-8c26-4ddb-935e-eb12991e5d2b): created successfully Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e8ebba-ae9e-4431-941b-9168157842d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Flow 'volume_create_manager' (3f63463e-bf72-4287-afd7-3befd2326bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:08 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-dd4902b4-5c4a-4b41-9bed-44811db0ccf7 tempest-VolumesDeleteCascade-1118704357 None] Created volume successfully. Nov 03 17:10:09 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c 1073741824" returned: 0 in 0.558s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:09 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c Nov 03 17:10:09 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:09 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c" returned: 0 in 0.279s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.871s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1594218938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8784d8d5-0bbc-44ac-a002-d7a30b39077d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6325463cf94308823bb27353d36524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:09:56Z,use_quota=True,user_id='895e418ded25452483cf35a49c80aa7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Creating volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:09 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:09 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d 1073741824 Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64af736e-74c9-4afe-92e5-ed07b8d7f9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:09 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f7a097-686f-4e48-b279-5b14a12c87b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:09 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Volume volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c (ef2d8485-c751-4e1b-ab85-960cd03bd89c): created successfully Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f7a097-686f-4e48-b279-5b14a12c87b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Flow 'volume_create_manager' (8fdd48eb-0a26-4205-982e-3ade77ea1179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5d536ebc-bab6-40f2-ba1e-f595aeb7a77a tempest-TestMinimumBasicScenario-658004077 None] Created volume successfully. Nov 03 17:10:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:10 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d 1073741824" returned: 0 in 0.452s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:10 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d Nov 03 17:10:10 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:10 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d" returned: 0 in 0.268s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.960s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a1669f-85ba-489a-a9e2-5c21be20c114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775b5460-5f0a-40b9-9d2c-8d7e16204d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffcaeca-87f4-467f-8bb6-482c4e1c9045]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:10 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Volume volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d (8784d8d5-0bbc-44ac-a002-d7a30b39077d): created successfully Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775b5460-5f0a-40b9-9d2c-8d7e16204d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Flow 'volume_create_manager' (dffea338-c0d9-4f9d-8796-df87ca0a13cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:10 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f238f715-092d-4328-9680-aacadfed128a tempest-SnapshotsActionsTest-221771998 None] Created volume successfully. Nov 03 17:10:10 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 Nov 03 17:10:10 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:11 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8" returned: 0 in 0.499s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:11 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1f023b-4db1-425d-86d0-3f72207c65b2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:11 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 Nov 03 17:10:11 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:11 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8" returned: 0 in 0.371s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:11 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img Nov 03 17:10:11 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-2ea03a72-7b5d-4b7d-ba93-0f7e4239c9d7 req-94f76d34-49ba-499f-b5f2-1e2ccdd8500c tempest-TestMinimumBasicScenario-658004077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:16 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img" returned: 0 in 5.531s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:16 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0aa3c0-293b-470e-9cd3-9dffe207f272]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:17 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 Nov 03 17:10:17 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:17 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8" returned: 0 in 0.506s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:17 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:10:17 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Converted 1024.00 MB image at 185.11 MB/s Nov 03 17:10:17 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] 5e34e6dd-0293-48fc-bd10-5335ac98c225 was raw, converting to qcow2 {{(pid=86661) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 17:10:17 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f3b88b-5a18-416a-8072-0ec8e779a4cd]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:17 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img Nov 03 17:10:17 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:17 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img" returned: 0 in 0.315s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:17 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img Nov 03 17:10:17 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:18 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img" returned: 1 in 0.323s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:10:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img /opt/stack/data/cinder/conversion/vol_upload_bycsatdp {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:18 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img /opt/stack/data/cinder/conversion/vol_upload_bycsatdp Nov 03 17:10:18 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:18 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img /opt/stack/data/cinder/conversion/vol_upload_bycsatdp" returned: 0 in 0.246s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:18 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Image conversion details: src /opt/stack/data/cinder/conversion/0ac3acee-c86b-4e1e-be55-53489463cdf8.temp_image.5e34e6dd-0293-48fc-bd10-5335ac98c225n8bjyq2g.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_bycsatdp {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:10:18 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 17:10:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede9fdc8-9b45-4a9a-a008-b98800ef6bdc]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bycsatdp {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:18 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bycsatdp Nov 03 17:10:18 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:18 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bycsatdp" returned: 0 in 0.319s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.535s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:20 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Uploaded volume to glance image-id: 5e34e6dd-0293-48fc-bd10-5335ac98c225. {{(pid=86661) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 17:10:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.129s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] Creating offline snapshot b3772a68-bce1-4c08-9c57-d4d830f20995 of volume b19cd897-8c26-4ddb-935e-eb12991e5d2b {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:10:20 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-de94b1b3-169f-4845-ba80-166425b21ef8 tempest-VolumesActionsTest-1170140135 None] Copy volume to image completed successfully. Nov 03 17:10:20 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5fd337-2095-4f9c-9207-c6c26878f5e8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:20 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b Nov 03 17:10:20 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:20 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b" returned: 0 in 0.374s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:20 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 1G Nov 03 17:10:20 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:20 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 1G" returned: 0 in 0.447s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:20 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 Nov 03 17:10:20 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:21 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995" returned: 0 in 0.364s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:21 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 is being set with open permissions: ugo+rw Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:21 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 Nov 03 17:10:21 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:21 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995" returned: 0 in 0.272s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:21 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.info Nov 03 17:10:21 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Acquiring lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Acquiring lock "cinder-quobyte-0ac3acee-c86b-4e1e-be55-53489463cdf8" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Lock "cinder-quobyte-0ac3acee-c86b-4e1e-be55-53489463cdf8" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1315f5-3d3c-47e1-a586-f32abe7c6487]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:21 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.info" returned: 0 in 0.284s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:21 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.info is being set with open permissions: ugo+rw Nov 03 17:10:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:21 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.info Nov 03 17:10:21 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:21 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 Nov 03 17:10:21 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:22 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.info" returned: 0 in 0.244s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.170s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] Creating offline snapshot 2a7d4118-4f15-42b0-84c8-c611ec770962 of volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:10:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-872420ec-f344-4c56-b3ff-7957ef5d550f tempest-VolumesDeleteCascade-1118704357 None] Create snapshot completed successfully Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9ebdec-2f73-4923-b8ac-82baeaa30b55]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:22 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8" returned: 0 in 0.411s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:22 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8 Nov 03 17:10:22 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:22 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d Nov 03 17:10:22 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:22 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0ac3acee-c86b-4e1e-be55-53489463cdf8" returned: 0 in 0.255s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Lock "cinder-quobyte-0ac3acee-c86b-4e1e-be55-53489463cdf8" released by "delete_volume" :: held 0.716s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Created reservations ['8d13a731-9f11-40e7-827b-32b533b854c5', '6fb81861-b391-43e9-a0ae-9335e6fcfb0f', '1b1503dc-7c94-4383-a24d-ce2e631e925c', '1af00a0c-8297-4ab4-8ad5-e9c0e2a62d67'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:22 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d" returned: 0 in 0.379s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:22 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 1G Nov 03 17:10:22 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:22 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:10:22 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:22 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.270s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:10:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Deleted volume successfully. Nov 03 17:10:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d228e5c3-0daa-4bda-9d33-82dfa030504e tempest-VolumesActionsTest-1170140135 None] Lock "cinder-0ac3acee-c86b-4e1e-be55-53489463cdf8-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:23 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 1G" returned: 0 in 0.574s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:23 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:10:23 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Flow 'volume_create_manager' (b3f5ec90-544f-4e3e-9b93-e4340aa1ff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6209e717-6bc0-4912-8185-a4b75f257d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6209e717-6bc0-4912-8185-a4b75f257d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-622103010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d8f9fd-3d31-480f-985a-e48bdfade610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1637a655f64a9e8c6236181f22e30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b3772a68-bce1-4c08-9c57-d4d830f20995,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:23Z,use_quota=True,user_id='3d7adcff13dc45d9b3a140f02a721e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a54632f-1bc8-4ec1-af0b-b18f465277e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a54632f-1bc8-4ec1-af0b-b18f465277e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf56dee1-c05a-40ce-b681-f70974e3ccf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf56dee1-c05a-40ce-b681-f70974e3ccf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '66d8f9fd-3d31-480f-985a-e48bdfade610', 'volume_name': 'volume-66d8f9fd-3d31-480f-985a-e48bdfade610', 'volume_size': 1, 'snapshot_id': 'b3772a68-bce1-4c08-9c57-d4d830f20995'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb472d6-1ec9-4268-8b24-73f674fd8ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb472d6-1ec9-4268-8b24-73f674fd8ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4667c8b9-6b50-48c0-91d6-259875efed02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:23 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Volume 66d8f9fd-3d31-480f-985a-e48bdfade610: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-66d8f9fd-3d31-480f-985a-e48bdfade610', 'volume_size': 1, 'snapshot_id': 'b3772a68-bce1-4c08-9c57-d4d830f20995'} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:23 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.338s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:23 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 is being set with open permissions: ugo+rw Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:23 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:10:23 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:23 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.236s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:23 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.info Nov 03 17:10:23 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:24 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.info" returned: 0 in 0.273s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:24 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.info is being set with open permissions: ugo+rw Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:24 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.info Nov 03 17:10:24 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:24 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.info" returned: 0 in 0.272s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-2ea03a72-7b5d-4b7d-ba93-0f7e4239c9d7 req-94f76d34-49ba-499f-b5f2-1e2ccdd8500c tempest-TestMinimumBasicScenario-658004077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.770s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-2ea03a72-7b5d-4b7d-ba93-0f7e4239c9d7 req-94f76d34-49ba-499f-b5f2-1e2ccdd8500c tempest-TestMinimumBasicScenario-658004077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.019s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-quobyte-b3772a68-bce1-4c08-9c57-d4d830f20995-66d8f9fd-3d31-480f-985a-e48bdfade610" by "_create_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f1ab37f2-d47e-492a-9cfb-9c1bf85970e7 tempest-SnapshotsActionsTest-221771998 None] Create snapshot completed successfully Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-b3772a68-bce1-4c08-9c57-d4d830f20995-66d8f9fd-3d31-480f-985a-e48bdfade610" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Creating volume 66d8f9fd-3d31-480f-985a-e48bdfade610 from snapshot b3772a68-bce1-4c08-9c57-d4d830f20995 {{(pid=86661) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-quobyte-66d8f9fd-3d31-480f-985a-e48bdfade610" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-2ea03a72-7b5d-4b7d-ba93-0f7e4239c9d7 req-94f76d34-49ba-499f-b5f2-1e2ccdd8500c tempest-TestMinimumBasicScenario-658004077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de921b09-ed9b-435f-9616-104813d1a6b2', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-66d8f9fd-3d31-480f-985a-e48bdfade610" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] snapshot: b3772a68-bce1-4c08-9c57-d4d830f20995, volume: 66d8f9fd-3d31-480f-985a-e48bdfade610, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[96834348-db9f-404f-bd4f-57195b1db7bf]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-2ea03a72-7b5d-4b7d-ba93-0f7e4239c9d7 req-94f76d34-49ba-499f-b5f2-1e2ccdd8500c tempest-TestMinimumBasicScenario-658004077 None] attachment_update completed successfully. Nov 03 17:10:24 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 Nov 03 17:10:24 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:24 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995" returned: 0 in 0.453s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b94aff-a2b8-4688-bbf8-32bb4f894eeb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:25 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b Nov 03 17:10:25 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:25 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b" returned: 0 in 0.551s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:10:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:10:25 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610 not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:10:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:25 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610 Nov 03 17:10:25 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:10:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:29 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:10:29 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:30 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.596s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:10:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:10:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:10:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:10:33 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610" returned: 0 in 8.346s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:33 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610 {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:10:33 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Converted 1024.00 MB image at 122.67 MB/s Nov 03 17:10:33 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610 is being set with open permissions: ugo+rw Nov 03 17:10:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:33 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610 Nov 03 17:10:33 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:34 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610" returned: 0 in 0.344s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-66d8f9fd-3d31-480f-985a-e48bdfade610" released by "_copy_volume_from_snapshot" :: held 9.816s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-b3772a68-bce1-4c08-9c57-d4d830f20995-66d8f9fd-3d31-480f-985a-e48bdfade610" released by "_create_volume_from_snapshot" :: held 9.901s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.931s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.367s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] Creating offline snapshot be90f6eb-91ec-407a-9f33-f1016e51926b of volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4667c8b9-6b50-48c0-91d6-259875efed02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d8f9fd-3d31-480f-985a-e48bdfade610', 'volume_size': 1, 'snapshot_id': 'b3772a68-bce1-4c08-9c57-d4d830f20995'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e53314-f6dc-48a9-ba14-ee4e8cc82f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6964413-17c6-44c5-8440-e23aa200c34e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:34 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Volume volume-66d8f9fd-3d31-480f-985a-e48bdfade610 (66d8f9fd-3d31-480f-985a-e48bdfade610): created successfully Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e53314-f6dc-48a9-ba14-ee4e8cc82f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Flow 'volume_create_manager' (b3f5ec90-544f-4e3e-9b93-e4340aa1ff91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:34 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6bf1046c-64c5-46a0-9bc8-368052da033a tempest-VolumesDeleteCascade-1118704357 None] Created volume successfully. Nov 03 17:10:34 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:10:34 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:34 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.491s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:10:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:34 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b 1G Nov 03 17:10:34 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Flow 'volume_create_manager' (9b954770-a9f2-4b49-8db1-dcb7a2ccd544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56768840-5058-4a74-a95d-f318db5fcdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56768840-5058-4a74-a95d-f318db5fcdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1286173007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b7bcfe-4008-4f7e-a648-bfadf5a02203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2467ce861e4b4a998e0bea3c4f4aa3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:35Z,use_quota=True,user_id='15ac22a36aa64ec98d369127d2becd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45d81e0-ed79-4cb7-b9fc-b72a1f264b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45d81e0-ed79-4cb7-b9fc-b72a1f264b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9dc3707-cf47-46ca-b56f-42df45a6a525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9dc3707-cf47-46ca-b56f-42df45a6a525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b7bcfe-4008-4f7e-a648-bfadf5a02203', 'volume_name': 'volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562f9a99-a277-4564-9e96-ed18d9446543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562f9a99-a277-4564-9e96-ed18d9446543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84592967-a63d-4204-836d-5966a5995701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:35 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Volume 25b7bcfe-4008-4f7e-a648-bfadf5a02203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203', 'volume_size': 1} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-b19cd897-8c26-4ddb-935e-eb12991e5d2b-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-b19cd897-8c26-4ddb-935e-eb12991e5d2b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Performing cascade delete. {{(pid=86661) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-b3772a68-bce1-4c08-9c57-d4d830f20995-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:35 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b 1G" returned: 0 in 0.630s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-b3772a68-bce1-4c08-9c57-d4d830f20995-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:35 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b Nov 03 17:10:35 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-quobyte-b19cd897-8c26-4ddb-935e-eb12991e5d2b" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-b19cd897-8c26-4ddb-935e-eb12991e5d2b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-quobyte-b3772a68-bce1-4c08-9c57-d4d830f20995" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-b3772a68-bce1-4c08-9c57-d4d830f20995" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Deleting offline snapshot b3772a68-bce1-4c08-9c57-d4d830f20995 of volume b19cd897-8c26-4ddb-935e-eb12991e5d2b {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] snapshot_file for this snap is: volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd4bc20-fc73-4fe1-a548-16ac59a42a53]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:35 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 Nov 03 17:10:35 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:35 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b" returned: 0 in 0.372s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:35 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b is being set with open permissions: ugo+rw Nov 03 17:10:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:35 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b Nov 03 17:10:35 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:36 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995" returned: 0 in 0.493s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:10:36 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b62848b-f601-4d5f-ad5a-78e36424d9d5]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b" returned: 0 in 0.291s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.054s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1286173007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b7bcfe-4008-4f7e-a648-bfadf5a02203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2467ce861e4b4a998e0bea3c4f4aa3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:35Z,use_quota=True,user_id='15ac22a36aa64ec98d369127d2becd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Creating volume 25b7bcfe-4008-4f7e-a648-bfadf5a02203 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:36 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:36 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 1073741824 Nov 03 17:10:36 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-26f60046-0b8d-485e-9509-c8ee6a8e4c76 tempest-SnapshotsActionsTest-221771998 None] Create snapshot completed successfully Nov 03 17:10:36 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b Nov 03 17:10:36 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:36 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 1073741824" returned: 0 in 0.550s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-be90f6eb-91ec-407a-9f33-f1016e51926b-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:36 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 Nov 03 17:10:36 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-be90f6eb-91ec-407a-9f33-f1016e51926b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-quobyte-be90f6eb-91ec-407a-9f33-f1016e51926b" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:36 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-be90f6eb-91ec-407a-9f33-f1016e51926b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Deleting offline snapshot be90f6eb-91ec-407a-9f33-f1016e51926b of volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] snapshot_file for this snap is: volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b" returned: 0 in 0.814s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:36 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c89b71-2b59-44d6-8fdb-40b25107baa0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:37 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 Nov 03 17:10:37 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:37 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b Nov 03 17:10:37 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:37 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203" returned: 0 in 0.353s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84592967-a63d-4204-836d-5966a5995701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2652d4-fef9-4d7f-8bd1-9fe9cc6d8a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:37 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Volume volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 (25b7bcfe-4008-4f7e-a648-bfadf5a02203): created successfully Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2652d4-fef9-4d7f-8bd1-9fe9cc6d8a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Flow 'volume_create_manager' (9b954770-a9f2-4b49-8db1-dcb7a2ccd544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:37 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-4df8c1df-7433-4990-ba97-61553155b3cc tempest-VolumesCloneTest-318564536 None] Created volume successfully. Nov 03 17:10:37 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b" returned: 0 in 0.474s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:10:37 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995" returned: 0 in 0.521s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2a9c5a-34d4-41c6-80a2-f2a3bbb18e1c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:37 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995 Nov 03 17:10:37 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:37 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:10:37 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:37 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b.b3772a68-bce1-4c08-9c57-d4d830f20995" returned: 0 in 0.363s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-b3772a68-bce1-4c08-9c57-d4d830f20995" released by "_delete_snapshot" :: held 2.327s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-b19cd897-8c26-4ddb-935e-eb12991e5d2b" released by "delete_snapshot" :: held 2.355s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Created reservations ['6b5de0a4-591f-423c-b21a-4f5136ad771a', 'a35dc6e7-08c9-4dd9-be80-c7b75c0252d7', '8f3c9115-917b-43da-9711-0d519c4f2849', '99fdfd0a-f8f2-4f15-8a7a-1d22ce04f772'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:38 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.542s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:38 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b Nov 03 17:10:38 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:38 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Delete snapshot completed successfully. Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-b3772a68-bce1-4c08-9c57-d4d830f20995-delete_snapshot" released by "delete_snapshot" :: held 2.637s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Snapshots deleted, issuing volume delete {{(pid=86661) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-quobyte-b19cd897-8c26-4ddb-935e-eb12991e5d2b" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-b19cd897-8c26-4ddb-935e-eb12991e5d2b" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[443e05b6-e773-480c-a66c-5a265f9bc12d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:38 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b Nov 03 17:10:38 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:38 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b" returned: 0 in 0.608s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:38 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b Nov 03 17:10:38 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:38 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b" returned: 0 in 0.634s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:38 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b Nov 03 17:10:38 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:39 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.be90f6eb-91ec-407a-9f33-f1016e51926b" returned: 0 in 0.350s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-be90f6eb-91ec-407a-9f33-f1016e51926b" released by "_delete_snapshot" :: held 2.128s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" released by "delete_snapshot" :: held 2.159s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Flow 'volume_create_manager' (5286c62b-ac6f-428e-9f9e-a21f641c3574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24067ca8-8f63-4f0e-89d8-215d8950dec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24067ca8-8f63-4f0e-89d8-215d8950dec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1300370133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0b1bec-ec5a-47ed-bb29-8f23784b3989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2467ce861e4b4a998e0bea3c4f4aa3ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=25b7bcfe-4008-4f7e-a648-bfadf5a02203,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:39Z,use_quota=True,user_id='15ac22a36aa64ec98d369127d2becd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f514cb-89d2-47d4-b5d2-ec268c40a40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f514cb-89d2-47d4-b5d2-ec268c40a40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9730fa0c-9d24-48ec-8083-a7a11d81fead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9730fa0c-9d24-48ec-8083-a7a11d81fead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'af0b1bec-ec5a-47ed-bb29-8f23784b3989', 'volume_name': 'volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989', 'volume_size': 2, 'source_volid': '25b7bcfe-4008-4f7e-a648-bfadf5a02203', 'source_volstatus': 'available'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa978ea-77c3-4a1f-a178-b9c252b9aa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:39 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa978ea-77c3-4a1f-a178-b9c252b9aa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ad4e28-303c-4a1f-8953-efca941f50c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:39 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Volume af0b1bec-ec5a-47ed-bb29-8f23784b3989: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989', 'volume_size': 2, 'source_volid': '25b7bcfe-4008-4f7e-a648-bfadf5a02203', 'source_volstatus': 'available'} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b19cd897-8c26-4ddb-935e-eb12991e5d2b" returned: 0 in 0.362s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:39 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Cloning volume 25b7bcfe-4008-4f7e-a648-bfadf5a02203 to volume af0b1bec-ec5a-47ed-bb29-8f23784b3989 Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-b19cd897-8c26-4ddb-935e-eb12991e5d2b" released by "delete_volume" :: held 1.183s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Created reservations ['83490de4-7c9f-4085-9cd4-f91ce09e99d0', 'ea569072-0ac3-4666-9363-a0b5d83b1311', 'ae702198-8e8b-4dbd-aafd-172d2185d4e6', '61cf8c2e-2585-4e0b-b51f-41eeb30d004b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Creating offline snapshot b258959f-2249-44f6-9ff9-47d5de23f5da of volume 25b7bcfe-4008-4f7e-a648-bfadf5a02203 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9cd551-f335-467e-8c2c-cf50c0e3c4e7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Created reservations ['02530dec-f8d1-4c2e-b10d-0ac82c278b08', '6cd2967c-4047-4f70-8d02-5f544b09b036', '0b0c5750-978c-440e-be3f-f22d50baaeab', 'bd3db486-f69c-4d23-9f4d-d6faa1b0bb78'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:39 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Delete snapshot completed successfully. Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7756a5d9-28db-4257-a7d0-3155d99f04d2 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-be90f6eb-91ec-407a-9f33-f1016e51926b-delete_snapshot" released by "delete_snapshot" :: held 2.644s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:39 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 Nov 03 17:10:39 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:39 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:10:39 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:39 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.266s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:10:39 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Deleted volume successfully. Nov 03 17:10:39 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203" returned: 0 in 0.442s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:39 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da 1G Nov 03 17:10:39 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cc715bf6-ee8c-4c69-952a-819ee7811f76 tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-b19cd897-8c26-4ddb-935e-eb12991e5d2b-delete_volume" released by "delete_volume" :: held 4.478s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-66d8f9fd-3d31-480f-985a-e48bdfade610-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-66d8f9fd-3d31-480f-985a-e48bdfade610-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "cinder-quobyte-66d8f9fd-3d31-480f-985a-e48bdfade610" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-66d8f9fd-3d31-480f-985a-e48bdfade610" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c77eaa5-9945-4aaa-b7a6-8cc9a844c245]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:40 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610 Nov 03 17:10:40 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:40 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da 1G" returned: 0 in 0.606s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:40 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da Nov 03 17:10:40 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:40 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610" returned: 0 in 0.434s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:40 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610 Nov 03 17:10:40 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:40 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da" returned: 0 in 0.342s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:40 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da is being set with open permissions: ugo+rw Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:40 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da Nov 03 17:10:40 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:40 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-66d8f9fd-3d31-480f-985a-e48bdfade610" returned: 0 in 0.333s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-quobyte-66d8f9fd-3d31-480f-985a-e48bdfade610" released by "delete_volume" :: held 0.835s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Created reservations ['54c5a3a9-f631-47e8-a41a-f8661073b7ca', '64433acc-0ed2-400d-a454-bc5f8abc4594', '9eb74012-0242-4db0-9f94-90155a748c9a', '45c39cf1-f300-45e3-898d-cf445e51c44b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:41 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da" returned: 0 in 0.315s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:41 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.info Nov 03 17:10:41 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:41 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:10:41 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:41 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:41 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.info" returned: 0 in 0.370s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:41 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.info is being set with open permissions: ugo+rw Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.383s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:10:41 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Deleted volume successfully. Nov 03 17:10:41 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.info Nov 03 17:10:41 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8a4a455f-76bf-4118-b696-3751d23ba35c tempest-VolumesDeleteCascade-1118704357 None] Lock "cinder-66d8f9fd-3d31-480f-985a-e48bdfade610-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:41 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.info" returned: 0 in 0.385s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Acquiring lock "cinder-quobyte-af0b1bec-ec5a-47ed-bb29-8f23784b3989" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Lock "cinder-quobyte-af0b1bec-ec5a-47ed-bb29-8f23784b3989" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] snapshot: b258959f-2249-44f6-9ff9-47d5de23f5da, volume: af0b1bec-ec5a-47ed-bb29-8f23784b3989, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:10:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:42 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a02fd9-61f0-4e92-8af1-f45f7e3001ca]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:42 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da Nov 03 17:10:42 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:42 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da" returned: 0 in 0.636s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:10:42 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d46dab2-e757-4dd6-9171-496f4416b1f9]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:42 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 Nov 03 17:10:42 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:43 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203" returned: 0 in 0.792s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:10:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:10:43 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:10:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:43 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 Nov 03 17:10:43 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:51 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=60,cinder:INSERT=13,cinder:UPDATE=55,cinder:DELETE=6 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:10:51 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=58,cinder:SELECT=53,cinder:DELETE=5,cinder:INSERT=16 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:10:52 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989" returned: 0 in 9.282s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:52 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203, size 1024.00 MB, duration 9.28 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:10:52 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Converted 1024.00 MB image at 110.30 MB/s Nov 03 17:10:52 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 is being set with open permissions: ugo+rw Nov 03 17:10:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:52 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 Nov 03 17:10:52 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:53 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989" returned: 0 in 0.245s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Lock "cinder-quobyte-af0b1bec-ec5a-47ed-bb29-8f23784b3989" released by "_copy_volume_from_snapshot" :: held 11.100s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Acquiring lock "cinder-quobyte-b258959f-2249-44f6-9ff9-47d5de23f5da" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Lock "cinder-quobyte-b258959f-2249-44f6-9ff9-47d5de23f5da" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Deleting offline snapshot b258959f-2249-44f6-9ff9-47d5de23f5da of volume 25b7bcfe-4008-4f7e-a648-bfadf5a02203 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:10:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] snapshot_file for this snap is: volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:10:54 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f745b7-ac81-428c-942a-db6fc4471f46]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:54 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da Nov 03 17:10:54 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:54 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da" returned: 0 in 0.408s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:10:54 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf6b49a-f3c5-40db-87c6-cfa96498efad]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:54 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 Nov 03 17:10:54 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:55 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203" returned: 0 in 0.597s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:55 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da Nov 03 17:10:55 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:55 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da" returned: 0 in 0.365s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:55 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da Nov 03 17:10:55 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:56 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203.b258959f-2249-44f6-9ff9-47d5de23f5da" returned: 0 in 0.318s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Lock "cinder-quobyte-b258959f-2249-44f6-9ff9-47d5de23f5da" released by "_delete_snapshot" :: held 1.785s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.481s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.388s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] Creating offline snapshot 32b34ba1-7fab-4656-b85e-3a8d07d9bafe of volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:10:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ad4e28-303c-4a1f-8953-efca941f50c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989', 'volume_size': 2, 'source_volid': '25b7bcfe-4008-4f7e-a648-bfadf5a02203', 'source_volstatus': 'available'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ece74a-725b-4cee-8b75-c7fa9652c2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:56 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba789498-078b-468f-afa8-67d2293938ed]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:56 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Flow 'volume_create_manager' (fab489f4-76e9-41e1-8171-9fb7ee6d558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b20333-4489-4245-b1d0-e392b3910746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:57 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Volume volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 (af0b1bec-ec5a-47ed-bb29-8f23784b3989): created successfully Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ece74a-725b-4cee-8b75-c7fa9652c2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Flow 'volume_create_manager' (5286c62b-ac6f-428e-9f9e-a21f641c3574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b20333-4489-4245-b1d0-e392b3910746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1190977895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8bef42-28e0-456f-b9a3-ba1add820097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2765ece5ca1489e95115fca4b9a976c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:56Z,use_quota=True,user_id='65801c664a054089930ee6f76c18f6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c177cab3-ff63-4882-b615-3cb460c902ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c177cab3-ff63-4882-b615-3cb460c902ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b761e1b-18af-4970-9795-183aa8cee7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:57 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:10:57 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b761e1b-18af-4970-9795-183aa8cee7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e8bef42-28e0-456f-b9a3-ba1add820097', 'volume_name': 'volume-0e8bef42-28e0-456f-b9a3-ba1add820097', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7e1350-3e41-43e5-86db-e61c29fb12cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7e1350-3e41-43e5-86db-e61c29fb12cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c578421-d3c8-41e2-b5b9-4cce84844843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:57 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Volume 0e8bef42-28e0-456f-b9a3-ba1add820097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e8bef42-28e0-456f-b9a3-ba1add820097', 'volume_size': 1} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:57 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3eb6d178-6983-4f89-9a04-355f9f7bab57 tempest-VolumesCloneTest-318564536 None] Created volume successfully. Nov 03 17:10:57 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.390s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:57 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe 1G Nov 03 17:10:57 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:57 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe 1G" returned: 0 in 0.440s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:57 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe Nov 03 17:10:57 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:58 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe" returned: 0 in 0.283s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:58 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe is being set with open permissions: ugo+rw Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:58 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe Nov 03 17:10:58 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:58 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe" returned: 0 in 0.274s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.536s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1190977895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8bef42-28e0-456f-b9a3-ba1add820097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2765ece5ca1489e95115fca4b9a976c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:10:56Z,use_quota=True,user_id='65801c664a054089930ee6f76c18f6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Creating volume 0e8bef42-28e0-456f-b9a3-ba1add820097 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:10:58 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:58 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097 1073741824 Nov 03 17:10:58 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:58 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-fe952204-4df4-4385-9ff7-acc673004ae2 tempest-SnapshotsActionsTest-221771998 None] Create snapshot completed successfully Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Acquiring lock "cinder-af0b1bec-ec5a-47ed-bb29-8f23784b3989-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Lock "cinder-af0b1bec-ec5a-47ed-bb29-8f23784b3989-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Acquiring lock "cinder-quobyte-af0b1bec-ec5a-47ed-bb29-8f23784b3989" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Lock "cinder-quobyte-af0b1bec-ec5a-47ed-bb29-8f23784b3989" acquired by "delete_volume" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6497c958-36fd-464a-80ed-886367130e73]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:58 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097 1073741824" returned: 0 in 0.567s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:59 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 Nov 03 17:10:59 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:59 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097 Nov 03 17:10:59 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:59 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:59 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097" returned: 0 in 0.336s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989" returned: 0 in 0.453s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c578421-d3c8-41e2-b5b9-4cce84844843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8bef42-28e0-456f-b9a3-ba1add820097', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8441d038-45af-447e-8938-dae8817a01f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:10:59 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989 Nov 03 17:10:59 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:59 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Volume volume-0e8bef42-28e0-456f-b9a3-ba1add820097 (0e8bef42-28e0-456f-b9a3-ba1add820097): created successfully Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8441d038-45af-447e-8938-dae8817a01f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Flow 'volume_create_manager' (fab489f4-76e9-41e1-8171-9fb7ee6d558b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:10:59 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-85896e20-b5d6-44c5-9be8-ce70014d6aaf tempest-VolumesTransfersTest-1472099289 None] Created volume successfully. Nov 03 17:10:59 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-af0b1bec-ec5a-47ed-bb29-8f23784b3989" returned: 0 in 0.256s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Lock "cinder-quobyte-af0b1bec-ec5a-47ed-bb29-8f23784b3989" released by "delete_volume" :: held 0.761s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Created reservations ['b65d2f31-bf2c-4aa8-8a35-9570d0927357', '9914ecac-5218-40d7-a9b3-f65e904c579c', 'a398ca2a-2fdd-4215-8cf4-0b8df4a20f8b', '011aeabf-de2f-467d-8339-bea4425f19a9'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:10:59 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:10:59 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-32b34ba1-7fab-4656-b85e-3a8d07d9bafe-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-32b34ba1-7fab-4656-b85e-3a8d07d9bafe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-quobyte-32b34ba1-7fab-4656-b85e-3a8d07d9bafe" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-32b34ba1-7fab-4656-b85e-3a8d07d9bafe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Deleting offline snapshot 32b34ba1-7fab-4656-b85e-3a8d07d9bafe of volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] snapshot_file for this snap is: volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1282dd49-8982-4791-9ec5-03262d481ff0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:10:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:00 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.263s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Acquiring lock "cinder-25b7bcfe-4008-4f7e-a648-bfadf5a02203-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:00 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Deleted volume successfully. Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Lock "cinder-25b7bcfe-4008-4f7e-a648-bfadf5a02203-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-448bdcd0-cd3d-4834-8d30-a70a8e197809 tempest-VolumesCloneTest-318564536 None] Lock "cinder-af0b1bec-ec5a-47ed-bb29-8f23784b3989-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:00 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe Nov 03 17:11:00 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Acquiring lock "cinder-quobyte-25b7bcfe-4008-4f7e-a648-bfadf5a02203" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Lock "cinder-quobyte-25b7bcfe-4008-4f7e-a648-bfadf5a02203" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[557af01d-51c6-447d-b205-93b4e2945dcd]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:00 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 Nov 03 17:11:00 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:00 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe" returned: 0 in 0.439s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c102b8a2-c4cf-44e4-b3f5-9975a8e6a7dd]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:00 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:11:00 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:00 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203" returned: 0 in 0.419s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:00 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203 Nov 03 17:11:00 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:00 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.447s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:00 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe Nov 03 17:11:00 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:00 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-25b7bcfe-4008-4f7e-a648-bfadf5a02203" returned: 0 in 0.355s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Lock "cinder-quobyte-25b7bcfe-4008-4f7e-a648-bfadf5a02203" released by "delete_volume" :: held 0.855s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Created reservations ['f9cf4b49-ba7a-4f85-9078-7b11ddc72e0c', '5ac3c8b9-263c-4997-b20b-1a3f532386e7', '13293fb2-3b92-4a6e-83b5-26c78ea107f5', '6ef07f51-deca-4c19-b198-b5cd54475b7a'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:01 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:01 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:01 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c7f864d6-a499-46cd-8d85-007f682a9dea tempest-VolumesTransfersTest-657405028 None] Transfer volume completed successfully. Nov 03 17:11:01 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe" returned: 0 in 0.570s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:01 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.383s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:01 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe Nov 03 17:11:01 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:01 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Deleted volume successfully. Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-79bf84f1-0d89-491c-8fed-2f2efbe523c2 tempest-VolumesCloneTest-318564536 None] Lock "cinder-25b7bcfe-4008-4f7e-a648-bfadf5a02203-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:01 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.32b34ba1-7fab-4656-b85e-3a8d07d9bafe" returned: 0 in 0.364s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-32b34ba1-7fab-4656-b85e-3a8d07d9bafe" released by "_delete_snapshot" :: held 1.933s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" released by "delete_snapshot" :: held 1.959s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:01 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Created reservations ['048ca803-7912-4ca4-9b2b-fb5885de268d', '0b293065-117b-4747-9f30-a84d99c9d0ca', 'ad790118-6066-481b-8efb-6e53fc27fe76', '46bd357c-0bca-4742-b59f-34743a41fc63'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Delete snapshot completed successfully. Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e2df7ab6-6da8-4ebb-945c-3567102b15c9 tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-32b34ba1-7fab-4656-b85e-3a8d07d9bafe-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Acquiring lock "cinder-0e8bef42-28e0-456f-b9a3-ba1add820097-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Lock "cinder-0e8bef42-28e0-456f-b9a3-ba1add820097-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Acquiring lock "cinder-quobyte-0e8bef42-28e0-456f-b9a3-ba1add820097" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Lock "cinder-quobyte-0e8bef42-28e0-456f-b9a3-ba1add820097" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c739e2c-f666-429f-b5d2-0f5b72e8b1f3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] Creating offline snapshot 8495d80e-18e7-4612-a819-036c9808e041 of volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:11:02 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097 Nov 03 17:11:02 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c863297d-8bc5-4250-8d60-1a87d2fa1f6c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:02 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:11:02 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:02 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097" returned: 0 in 0.415s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:02 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097 Nov 03 17:11:02 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:03 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.445s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:03 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 1G Nov 03 17:11:03 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:03 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0e8bef42-28e0-456f-b9a3-ba1add820097" returned: 0 in 0.298s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Lock "cinder-quobyte-0e8bef42-28e0-456f-b9a3-ba1add820097" released by "delete_volume" :: held 0.787s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Created reservations ['55c97885-e719-4365-b639-2abc4cc86788', 'a529cc9e-d6b1-4e59-bc8b-6f3af80bc300', '5b0aeb5c-9e4b-42dd-80dc-c98d874005fd', 'b072a342-1d93-44b2-b8ce-7f13e950b354'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:03 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:03 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:03 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 1G" returned: 0 in 0.592s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:03 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 Nov 03 17:11:03 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:03 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.353s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:03 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Deleted volume successfully. Nov 03 17:11:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-32a3d61c-9807-4a54-9fb2-55f0ffaa85e7 tempest-VolumesTransfersTest-787419446 None] Lock "cinder-0e8bef42-28e0-456f-b9a3-ba1add820097-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:04 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041" returned: 0 in 0.436s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:04 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 is being set with open permissions: ugo+rw Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:04 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 Nov 03 17:11:04 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Flow 'volume_create_manager' (b15e5782-5f14-4ad3-ab29-7a7d6d7f4abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4581909-675d-4423-9cf1-3063fa714b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4581909-675d-4423-9cf1-3063fa714b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-140398081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab1f896-d501-4fc9-91cb-f2e1c774d25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2765ece5ca1489e95115fca4b9a976c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:04Z,use_quota=True,user_id='65801c664a054089930ee6f76c18f6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd130c0c-81bf-43dd-ad0c-5892b51b387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd130c0c-81bf-43dd-ad0c-5892b51b387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af695da-7f28-4613-a366-b60130e61997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af695da-7f28-4613-a366-b60130e61997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab1f896-d501-4fc9-91cb-f2e1c774d25d', 'volume_name': 'volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664a2e4c-56bd-4660-b0de-7ecd86cdd11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664a2e4c-56bd-4660-b0de-7ecd86cdd11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a5adfa-c184-4d15-8160-1e5beed14a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:04 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Volume 3ab1f896-d501-4fc9-91cb-f2e1c774d25d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d', 'volume_size': 1} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:04 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041" returned: 0 in 0.247s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-140398081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab1f896-d501-4fc9-91cb-f2e1c774d25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2765ece5ca1489e95115fca4b9a976c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:04Z,use_quota=True,user_id='65801c664a054089930ee6f76c18f6b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Creating volume 3ab1f896-d501-4fc9-91cb-f2e1c774d25d {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:04 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:04 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d 1073741824 Nov 03 17:11:04 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b700e7b1-a5ea-44d5-957e-66552055f079 tempest-SnapshotsActionsTest-221771998 None] Create snapshot completed successfully Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-8495d80e-18e7-4612-a819-036c9808e041-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-8495d80e-18e7-4612-a819-036c9808e041-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-quobyte-8495d80e-18e7-4612-a819-036c9808e041" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-8495d80e-18e7-4612-a819-036c9808e041" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Deleting offline snapshot 8495d80e-18e7-4612-a819-036c9808e041 of volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] snapshot_file for this snap is: volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a074b2-f463-4152-be7e-35386224e587]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:04 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d 1073741824" returned: 0 in 0.553s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:04 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 Nov 03 17:11:04 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:04 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d Nov 03 17:11:04 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:05 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d" returned: 0 in 0.277s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a5adfa-c184-4d15-8160-1e5beed14a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3ea176-68f3-49c4-848f-d884bc53d801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:05 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Volume volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d (3ab1f896-d501-4fc9-91cb-f2e1c774d25d): created successfully Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3ea176-68f3-49c4-848f-d884bc53d801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Flow 'volume_create_manager' (b15e5782-5f14-4ad3-ab29-7a7d6d7f4abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:05 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041" returned: 0 in 0.476s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:05 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-0db59b6e-684c-475a-a12b-3d594183d5ba tempest-VolumesTransfersTest-1472099289 None] Created volume successfully. Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2717b9-3ba5-4bd1-860f-9c0002410242]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:05 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:11:05 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:05 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.484s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:05 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 Nov 03 17:11:05 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Flow 'volume_create_manager' (7f870e7c-4858-4abd-823a-4504ac222f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93890012-6ead-4c10-b72e-37fed7ee4443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93890012-6ead-4c10-b72e-37fed7ee4443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-358344164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa66d483-8165-4bc8-93b7-a644038a6f52,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d831a0a3fb24b949f7dfdbfff5833d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:06Z,use_quota=True,user_id='dbd117335c744f6f8d1b6584c30bda8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80517572-e6a6-47ec-aab8-6e8633149e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80517572-e6a6-47ec-aab8-6e8633149e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d12dff7-2f81-415a-ab6b-b42b4c614490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d12dff7-2f81-415a-ab6b-b42b4c614490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa66d483-8165-4bc8-93b7-a644038a6f52', 'volume_name': 'volume-aa66d483-8165-4bc8-93b7-a644038a6f52', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef92a02-1e7f-4ba6-818d-e7b5de6cbe6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef92a02-1e7f-4ba6-818d-e7b5de6cbe6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb934b0-d7c3-4d37-ac7c-ef5869443d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:06 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Volume aa66d483-8165-4bc8-93b7-a644038a6f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa66d483-8165-4bc8-93b7-a644038a6f52', 'volume_size': 1} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-358344164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa66d483-8165-4bc8-93b7-a644038a6f52,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d831a0a3fb24b949f7dfdbfff5833d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:06Z,use_quota=True,user_id='dbd117335c744f6f8d1b6584c30bda8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Creating volume aa66d483-8165-4bc8-93b7-a644038a6f52 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:06 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:06 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52 1073741824 Nov 03 17:11:06 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:06 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041" returned: 0 in 0.439s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:06 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041 Nov 03 17:11:06 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:06 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.8495d80e-18e7-4612-a819-036c9808e041" returned: 0 in 0.286s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-8495d80e-18e7-4612-a819-036c9808e041" released by "_delete_snapshot" :: held 1.812s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" released by "delete_snapshot" :: held 1.840s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Acquiring lock "cinder-3ab1f896-d501-4fc9-91cb-f2e1c774d25d-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Lock "cinder-3ab1f896-d501-4fc9-91cb-f2e1c774d25d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:06 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52 1073741824" returned: 0 in 0.617s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Created reservations ['aa18cd50-e8d6-463c-b170-7b6f41712448', 'd798f920-661b-4959-b935-139eb5cbd790', '891334ad-e945-4e22-9e56-d17a27164ba0', '0ceb6568-b31f-47d3-825a-ae27a3f51707'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Acquiring lock "cinder-quobyte-3ab1f896-d501-4fc9-91cb-f2e1c774d25d" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Lock "cinder-quobyte-3ab1f896-d501-4fc9-91cb-f2e1c774d25d" acquired by "delete_volume" :: waited 0.033s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:06 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52 Nov 03 17:11:06 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e0ae95-cd4e-4db6-a765-37effaed76d0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:06 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Delete snapshot completed successfully. Nov 03 17:11:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-08191496-d238-4abd-8750-cd620070ef7b tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-8495d80e-18e7-4612-a819-036c9808e041-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:07 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d Nov 03 17:11:07 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:07 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52" returned: 0 in 0.388s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb934b0-d7c3-4d37-ac7c-ef5869443d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa66d483-8165-4bc8-93b7-a644038a6f52', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1860fd6c-cca8-4cff-8b3a-99c389a86328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:07 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Volume volume-aa66d483-8165-4bc8-93b7-a644038a6f52 (aa66d483-8165-4bc8-93b7-a644038a6f52): created successfully Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1860fd6c-cca8-4cff-8b3a-99c389a86328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Flow 'volume_create_manager' (7f870e7c-4858-4abd-823a-4504ac222f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:07 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-da32b78f-446b-40ed-a6dd-76c5cc01af4a tempest-VolumesListTestJSON-717762544 None] Created volume successfully. Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] Creating offline snapshot 3d63e227-9aa5-4394-9c3e-f3a98b57808e of volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:11:07 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d" returned: 0 in 0.679s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f80c4-bdfd-4af3-b01a-811943a80ca4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:07 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d Nov 03 17:11:07 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:07 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:11:07 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:07 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3ab1f896-d501-4fc9-91cb-f2e1c774d25d" returned: 0 in 0.406s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Lock "cinder-quobyte-3ab1f896-d501-4fc9-91cb-f2e1c774d25d" released by "delete_volume" :: held 1.162s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:08 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.478s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:08 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e 1G Nov 03 17:11:08 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Created reservations ['aecff720-197c-4fe3-b2ec-87aeba9492be', 'a147294f-dd64-4a0f-98d0-1c89dbd77852', 'fb0b9ae5-80af-4bde-bba2-4663015c8bfc', 'c5843df1-b5bd-4c50-9db4-d51f2e2e36c0'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:08 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:08 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:08 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.448s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:08 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Deleted volume successfully. Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-deea83ef-2de3-45a3-adc8-9654cd6eb07e tempest-VolumesTransfersTest-787419446 None] Lock "cinder-3ab1f896-d501-4fc9-91cb-f2e1c774d25d-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:08 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e 1G" returned: 0 in 0.888s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:08 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e Nov 03 17:11:08 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:09 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e" returned: 0 in 0.412s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:09 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e is being set with open permissions: ugo+rw Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:09 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e Nov 03 17:11:09 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Flow 'volume_create_manager' (513ca734-23aa-40bf-9d16-a7a31c896a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1340eb0-e745-460c-8826-4f6f9138ff74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1340eb0-e745-460c-8826-4f6f9138ff74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2050082026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b2daa4-f14d-4242-8594-f4a555ee9ca2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d831a0a3fb24b949f7dfdbfff5833d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:09Z,use_quota=True,user_id='dbd117335c744f6f8d1b6584c30bda8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19753d7-d07e-4c9e-8b33-26ecdecad185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19753d7-d07e-4c9e-8b33-26ecdecad185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65520bb2-1f98-4de1-8634-52c2b1bf5bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65520bb2-1f98-4de1-8634-52c2b1bf5bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b2daa4-f14d-4242-8594-f4a555ee9ca2', 'volume_name': 'volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4bebd0-ab73-44c9-a6dd-0818202af67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4bebd0-ab73-44c9-a6dd-0818202af67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00ad10a-a610-4791-ac89-6348fb516aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:09 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Volume 30b2daa4-f14d-4242-8594-f4a555ee9ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2', 'volume_size': 1} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:09 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e" returned: 0 in 0.359s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.312s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2050082026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b2daa4-f14d-4242-8594-f4a555ee9ca2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d831a0a3fb24b949f7dfdbfff5833d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:09Z,use_quota=True,user_id='dbd117335c744f6f8d1b6584c30bda8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Creating volume 30b2daa4-f14d-4242-8594-f4a555ee9ca2 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:09 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:11:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:09 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2 1073741824 Nov 03 17:11:09 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-65836294-17ca-438d-9b05-8396e27d3042 tempest-SnapshotsActionsTest-221771998 None] Create snapshot completed successfully Nov 03 17:11:10 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2 1073741824" returned: 0 in 0.568s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:10 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2 Nov 03 17:11:10 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:10 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2" returned: 0 in 0.260s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00ad10a-a610-4791-ac89-6348fb516aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b363d0-cb8e-4202-985f-a9cfe279132a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:10 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Volume volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2 (30b2daa4-f14d-4242-8594-f4a555ee9ca2): created successfully Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b363d0-cb8e-4202-985f-a9cfe279132a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Flow 'volume_create_manager' (513ca734-23aa-40bf-9d16-a7a31c896a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:10 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-04b7c568-e35a-47f1-a5f9-87f2b529c632 tempest-VolumesListTestJSON-717762544 None] Created volume successfully. Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-3d63e227-9aa5-4394-9c3e-f3a98b57808e-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-3d63e227-9aa5-4394-9c3e-f3a98b57808e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Acquiring lock "cinder-quobyte-3d63e227-9aa5-4394-9c3e-f3a98b57808e" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-3d63e227-9aa5-4394-9c3e-f3a98b57808e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Deleting offline snapshot 3d63e227-9aa5-4394-9c3e-f3a98b57808e of volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] snapshot_file for this snap is: volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7677348a-b834-4a2d-b358-6a097406c08c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:10 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e Nov 03 17:11:10 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:11 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e" returned: 0 in 0.406s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:11 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7f663d-713a-4dee-b60d-17177a371620]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:11 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:11:11 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:11 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.448s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:11 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e Nov 03 17:11:11 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Flow 'volume_create_manager' (e826e558-496b-484b-b1c2-5c2fee0af006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc3818b-f7f8-4e10-ac9b-5fb0ff1c69d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc3818b-f7f8-4e10-ac9b-5fb0ff1c69d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2087015999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8b701e-6e11-4296-b115-b664e97aea22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d831a0a3fb24b949f7dfdbfff5833d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:12Z,use_quota=True,user_id='dbd117335c744f6f8d1b6584c30bda8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bdd8af-95a8-40a1-81f1-0babe94e1a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bdd8af-95a8-40a1-81f1-0babe94e1a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ace720e-7392-429a-83e6-d1c00659f849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ace720e-7392-429a-83e6-d1c00659f849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8b701e-6e11-4296-b115-b664e97aea22', 'volume_name': 'volume-6b8b701e-6e11-4296-b115-b664e97aea22', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714ea65e-1009-4e5e-bfc6-34ce25f09672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714ea65e-1009-4e5e-bfc6-34ce25f09672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97be5e8d-3075-4450-a05a-e3d147dd139d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:12 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Volume 6b8b701e-6e11-4296-b115-b664e97aea22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8b701e-6e11-4296-b115-b664e97aea22', 'volume_size': 1} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2087015999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8b701e-6e11-4296-b115-b664e97aea22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d831a0a3fb24b949f7dfdbfff5833d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:12Z,use_quota=True,user_id='dbd117335c744f6f8d1b6584c30bda8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Creating volume 6b8b701e-6e11-4296-b115-b664e97aea22 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:12 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:12 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22 1073741824 Nov 03 17:11:12 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:12 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e" returned: 0 in 0.509s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:12 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e Nov 03 17:11:12 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:12 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.3d63e227-9aa5-4394-9c3e-f3a98b57808e" returned: 0 in 0.323s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-3d63e227-9aa5-4394-9c3e-f3a98b57808e" released by "_delete_snapshot" :: held 1.842s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" released by "delete_snapshot" :: held 1.865s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:12 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22 1073741824" returned: 0 in 0.550s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:12 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22 Nov 03 17:11:12 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Created reservations ['54cecc29-d3a2-4a43-87b2-3e7ad95485c5', 'acf2eba0-b021-41e6-bab4-6341cd5da1e0', '4194b004-707c-48aa-8719-f6e7bfa7889c', '4f60098b-a9f9-4c02-8df9-0d3a8e4c0de2'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:12 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Delete snapshot completed successfully. Nov 03 17:11:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f11f2e1e-fc1f-42f5-ac80-e007ed7b361d tempest-SnapshotsActionsTest-1235657988 None] Lock "cinder-3d63e227-9aa5-4394-9c3e-f3a98b57808e-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:13 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22" returned: 0 in 0.309s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97be5e8d-3075-4450-a05a-e3d147dd139d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8b701e-6e11-4296-b115-b664e97aea22', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8489cb-1d6e-4073-8980-0ac45224a55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:13 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Volume volume-6b8b701e-6e11-4296-b115-b664e97aea22 (6b8b701e-6e11-4296-b115-b664e97aea22): created successfully Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8489cb-1d6e-4073-8980-0ac45224a55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Flow 'volume_create_manager' (e826e558-496b-484b-b1c2-5c2fee0af006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:13 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3f267635-98c6-4052-a7ae-787c2f70c7bd tempest-VolumesListTestJSON-717762544 None] Created volume successfully. Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "cinder-2a7d4118-4f15-42b0-84c8-c611ec770962-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Lock "cinder-2a7d4118-4f15-42b0-84c8-c611ec770962-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "cinder-quobyte-2a7d4118-4f15-42b0-84c8-c611ec770962" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Lock "cinder-quobyte-2a7d4118-4f15-42b0-84c8-c611ec770962" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Deleting offline snapshot 2a7d4118-4f15-42b0-84c8-c611ec770962 of volume 8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] snapshot_file for this snap is: volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab644ee-8bb8-42f9-894d-e22a11782f74]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:13 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:11:13 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:14 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.399s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:14 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7ae8a7-fa2a-48ec-b912-e4e305e53889]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:14 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d Nov 03 17:11:14 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:14 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d" returned: 0 in 0.427s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:14 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:11:14 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:15 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.398s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:15 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962 Nov 03 17:11:15 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:15 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d.2a7d4118-4f15-42b0-84c8-c611ec770962" returned: 0 in 0.310s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Lock "cinder-quobyte-2a7d4118-4f15-42b0-84c8-c611ec770962" released by "_delete_snapshot" :: held 1.694s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" released by "delete_snapshot" :: held 1.726s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:15 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Created reservations ['2ada20fa-c720-432d-88fc-6152563f2cec', '02144729-05df-412d-a5af-c80a0e4e2d7e', 'aa2a102f-92de-47d9-94cf-c34fc3cd3d7f', '2d3775ba-d636-4068-a083-80331214b3b0'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:15 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Delete snapshot completed successfully. Nov 03 17:11:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c8fdb10a-c9d1-417c-b454-d34a929d63a4 tempest-SnapshotsActionsTest-221771998 None] Lock "cinder-2a7d4118-4f15-42b0-84c8-c611ec770962-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "cinder-8784d8d5-0bbc-44ac-a002-d7a30b39077d-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Lock "cinder-8784d8d5-0bbc-44ac-a002-d7a30b39077d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" acquired by "delete_volume" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:16 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c220f0c2-8d30-410e-b17b-f6895ff252d1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:16 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d Nov 03 17:11:16 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:16 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d" returned: 0 in 0.460s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:16 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d Nov 03 17:11:16 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:16 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8784d8d5-0bbc-44ac-a002-d7a30b39077d" returned: 0 in 0.295s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Lock "cinder-quobyte-8784d8d5-0bbc-44ac-a002-d7a30b39077d" released by "delete_volume" :: held 0.841s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Acquiring lock "cinder-6b8b701e-6e11-4296-b115-b664e97aea22-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Lock "cinder-6b8b701e-6e11-4296-b115-b664e97aea22-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:16 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Created reservations ['678de177-92c0-40e0-b039-481e213d4a75', 'ba5a8fea-d9f1-43b7-b25c-c2eb28717eac', '741744da-c39d-4d3d-a866-923b38d2d426', '7f9c8d94-7163-4533-829b-082953aa6855'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Acquiring lock "cinder-quobyte-6b8b701e-6e11-4296-b115-b664e97aea22" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Lock "cinder-quobyte-6b8b701e-6e11-4296-b115-b664e97aea22" acquired by "delete_volume" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e463c564-fbad-425d-9196-71232c99fa55]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:17 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:17 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:17 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22 Nov 03 17:11:17 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:17 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.344s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:17 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Deleted volume successfully. Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bb8c5ce9-d9a4-4972-b6b0-7d8a05db69eb tempest-SnapshotsActionsTest-221771998 None] Lock "cinder-8784d8d5-0bbc-44ac-a002-d7a30b39077d-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:17 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22" returned: 0 in 0.521s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:17 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22 Nov 03 17:11:17 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:17 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6b8b701e-6e11-4296-b115-b664e97aea22" returned: 0 in 0.375s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Lock "cinder-quobyte-6b8b701e-6e11-4296-b115-b664e97aea22" released by "delete_volume" :: held 0.977s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Created reservations ['1d48e19e-92b6-4386-a09a-bdd2350adfbc', '187ed2e2-ae32-4108-822f-cfa9bdb06aeb', 'ee746e14-86e1-4a93-a3c3-4b97f374437e', '68b2892a-62e6-428d-9918-fc2107a9ba12'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:18 devstack sudo[98866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:18 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Flow 'volume_create_manager' (be1cf5bf-f7a1-499a-9104-4f18b5b174ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b488d1e-9686-458c-86d9-5d700d0fd26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b488d1e-9686-458c-86d9-5d700d0fd26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-578826210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76fd436-7c17-4005-8d80-5bf7709b46d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb687f6355fc4bfd8f27ac1e40f784e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:18Z,use_quota=True,user_id='7e65023e98a24bacac53109bc8064139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de79cb16-d43e-4826-bc46-bd49900e4e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de79cb16-d43e-4826-bc46-bd49900e4e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f90cf6b-2ed1-4482-8fcf-9a176a192987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f90cf6b-2ed1-4482-8fcf-9a176a192987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a76fd436-7c17-4005-8d80-5bf7709b46d5', 'volume_name': 'volume-a76fd436-7c17-4005-8d80-5bf7709b46d5', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb0e7a2-fff5-495e-9632-db4cd4ad1a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb0e7a2-fff5-495e-9632-db4cd4ad1a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d15265-cae3-4436-9859-5e578dd11b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:18 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Volume a76fd436-7c17-4005-8d80-5bf7709b46d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a76fd436-7c17-4005-8d80-5bf7709b46d5', 'volume_size': 1} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-578826210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76fd436-7c17-4005-8d80-5bf7709b46d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb687f6355fc4bfd8f27ac1e40f784e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:18Z,use_quota=True,user_id='7e65023e98a24bacac53109bc8064139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Creating volume a76fd436-7c17-4005-8d80-5bf7709b46d5 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:18 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:18 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5 1073741824 Nov 03 17:11:18 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:18 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.283s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:18 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Deleted volume successfully. Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72cd9046-7700-4743-8826-a760ae51fdae tempest-VolumesListTestJSON-717762544 None] Lock "cinder-6b8b701e-6e11-4296-b115-b664e97aea22-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:18 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5 1073741824" returned: 0 in 0.520s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:18 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5 Nov 03 17:11:18 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:19 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5" returned: 0 in 0.263s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d15265-cae3-4436-9859-5e578dd11b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76fd436-7c17-4005-8d80-5bf7709b46d5', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98aa0c01-c7f1-410d-8d2d-2cf538c33cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:19 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Volume volume-a76fd436-7c17-4005-8d80-5bf7709b46d5 (a76fd436-7c17-4005-8d80-5bf7709b46d5): created successfully Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98aa0c01-c7f1-410d-8d2d-2cf538c33cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Flow 'volume_create_manager' (be1cf5bf-f7a1-499a-9104-4f18b5b174ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:19 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5e510d65-2262-434d-af3c-f1a524d317f0 tempest-VolumesTransfersV355Test-604354285 None] Created volume successfully. Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Acquiring lock "cinder-30b2daa4-f14d-4242-8594-f4a555ee9ca2-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Lock "cinder-30b2daa4-f14d-4242-8594-f4a555ee9ca2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Acquiring lock "cinder-quobyte-30b2daa4-f14d-4242-8594-f4a555ee9ca2" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Lock "cinder-quobyte-30b2daa4-f14d-4242-8594-f4a555ee9ca2" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d748d7b-bf1f-441d-bbbe-6b0f401964d8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:19 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2 Nov 03 17:11:19 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:19 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2" returned: 0 in 0.397s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:19 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2 Nov 03 17:11:19 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:20 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-30b2daa4-f14d-4242-8594-f4a555ee9ca2" returned: 0 in 0.271s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Lock "cinder-quobyte-30b2daa4-f14d-4242-8594-f4a555ee9ca2" released by "delete_volume" :: held 0.724s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Created reservations ['e6335cb7-c585-45d6-8d58-0d1c8a8bda58', '5096a6d3-3aac-4d89-975d-1eb267c27140', 'bf45cefe-f6f1-4dfb-a0c6-8ec07cff6dd3', '6b6608b5-9012-4b63-978c-a4cf93a42390'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:20 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:20 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Acquiring lock "cinder-aa66d483-8165-4bc8-93b7-a644038a6f52-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:20 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.337s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Lock "cinder-aa66d483-8165-4bc8-93b7-a644038a6f52-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:20 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Deleted volume successfully. Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Acquiring lock "cinder-quobyte-aa66d483-8165-4bc8-93b7-a644038a6f52" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cbc8e0bd-fbbc-4335-867c-130a7218e992 tempest-VolumesListTestJSON-717762544 None] Lock "cinder-30b2daa4-f14d-4242-8594-f4a555ee9ca2-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Lock "cinder-quobyte-aa66d483-8165-4bc8-93b7-a644038a6f52" acquired by "delete_volume" :: waited 0.043s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[3964e277-f87d-409e-9cec-aca902ba9c7d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:20 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52 Nov 03 17:11:20 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:21 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52" returned: 0 in 0.388s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:21 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52 Nov 03 17:11:21 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-21d822d2-ab65-433c-81e3-c2287d1602c7 tempest-VolumesTransfersV355Test-1128686991 None] Transfer volume completed successfully. Nov 03 17:11:21 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-aa66d483-8165-4bc8-93b7-a644038a6f52" returned: 0 in 0.288s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Lock "cinder-quobyte-aa66d483-8165-4bc8-93b7-a644038a6f52" released by "delete_volume" :: held 0.742s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Created reservations ['5e9d9f08-62ae-4eb1-92a7-1a1b2b6cd1e2', '1919c452-bb29-4f70-979d-058149584f5e', 'b0ed1e97-c862-42b2-8905-0b752f730390', '05bafc22-0e40-4159-9127-2631f749bc61'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:21 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:21 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:21 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.288s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Deleted volume successfully. Nov 03 17:11:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c05f7979-e60c-4558-8b2c-39ac69bb49d4 tempest-VolumesListTestJSON-717762544 None] Lock "cinder-aa66d483-8165-4bc8-93b7-a644038a6f52-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Acquiring lock "cinder-a76fd436-7c17-4005-8d80-5bf7709b46d5-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Lock "cinder-a76fd436-7c17-4005-8d80-5bf7709b46d5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Acquiring lock "cinder-quobyte-a76fd436-7c17-4005-8d80-5bf7709b46d5" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Lock "cinder-quobyte-a76fd436-7c17-4005-8d80-5bf7709b46d5" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:22 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a3eb72-15d3-409a-8c8e-0dfbb8655643]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:22 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5 Nov 03 17:11:22 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:22 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5" returned: 0 in 0.498s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:22 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5 Nov 03 17:11:22 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:23 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a76fd436-7c17-4005-8d80-5bf7709b46d5" returned: 0 in 0.301s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Lock "cinder-quobyte-a76fd436-7c17-4005-8d80-5bf7709b46d5" released by "delete_volume" :: held 0.856s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Created reservations ['7a19f96e-b13e-45ea-815d-ee29c2a7c213', '02c29db3-b4b3-44f8-a10c-6ccb11b387bb', 'a76dac65-a865-4fa8-93a7-8d7c75ce110f', 'a0a2aba0-4b8e-47aa-8dc6-0e0545b1c9e6'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:23 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:23 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:23 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.522s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:23 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Deleted volume successfully. Nov 03 17:11:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9842062e-8053-487c-bdea-ee96d6bf0488 tempest-VolumesTransfersV355Test-1308239127 None] Lock "cinder-a76fd436-7c17-4005-8d80-5bf7709b46d5-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Flow 'volume_create_manager' (4f61ce11-7f15-4526-88b9-b53aaeff5000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd7787c-2799-4994-94d1-47eadf077ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd7787c-2799-4994-94d1-47eadf077ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2006272594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb687f6355fc4bfd8f27ac1e40f784e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:24Z,use_quota=True,user_id='7e65023e98a24bacac53109bc8064139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e680fecb-9c07-44b4-a2e3-64401c140158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e680fecb-9c07-44b4-a2e3-64401c140158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177f2479-e30d-439e-b36a-d368b14d0496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177f2479-e30d-439e-b36a-d368b14d0496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4', 'volume_name': 'volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a38dcc-9af4-4b6a-a282-2737e907b04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a38dcc-9af4-4b6a-a282-2737e907b04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e8fe79-4ef8-4282-9ab2-b74846e9d976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:24 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Volume ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4', 'volume_size': 1} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2006272594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb687f6355fc4bfd8f27ac1e40f784e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:24Z,use_quota=True,user_id='7e65023e98a24bacac53109bc8064139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Creating volume ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:24 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:11:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:24 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4 1073741824 Nov 03 17:11:24 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:25 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4 1073741824" returned: 0 in 0.770s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:25 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4 Nov 03 17:11:25 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:25 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4" returned: 0 in 0.367s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e8fe79-4ef8-4282-9ab2-b74846e9d976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdf456e-3b59-4a66-afca-188b4da98da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:25 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Volume volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4 (ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4): created successfully Nov 03 17:11:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdf456e-3b59-4a66-afca-188b4da98da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Flow 'volume_create_manager' (4f61ce11-7f15-4526-88b9-b53aaeff5000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c44c9998-bc20-4eb4-a033-cb79077c69af tempest-VolumesTransfersV355Test-604354285 None] Created volume successfully. Nov 03 17:11:26 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-936e01a9-9572-49e6-b497-764bff20b709 req-736097eb-6689-4466-a5fe-0a9e416a130b tempest-TestMinimumBasicScenario-658004077 None] Terminate volume connection completed successfully. Nov 03 17:11:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-936e01a9-9572-49e6-b497-764bff20b709 req-736097eb-6689-4466-a5fe-0a9e416a130b tempest-TestMinimumBasicScenario-658004077 None] Deleting attachment de921b09-ed9b-435f-9616-104813d1a6b2. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:11:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Acquiring lock "cinder-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Lock "cinder-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Acquiring lock "cinder-quobyte-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Lock "cinder-quobyte-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:27 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ca5fa5-29b1-4f7d-b16e-80fb55abab7b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:27 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4 Nov 03 17:11:27 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Acquiring lock "cinder-ef2d8485-c751-4e1b-ab85-960cd03bd89c-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Lock "cinder-ef2d8485-c751-4e1b-ab85-960cd03bd89c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:27 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4" returned: 0 in 0.686s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:27 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4 Nov 03 17:11:27 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Acquiring lock "cinder-quobyte-ef2d8485-c751-4e1b-ab85-960cd03bd89c" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Lock "cinder-quobyte-ef2d8485-c751-4e1b-ab85-960cd03bd89c" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:27 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7d5d02-4b04-426b-a9fb-906659d45777]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:28 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c Nov 03 17:11:28 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:28 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4" returned: 0 in 0.406s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Lock "cinder-quobyte-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4" released by "delete_volume" :: held 1.158s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Created reservations ['f8d00674-55c8-4af3-935c-9441b142031e', '8c0987f1-716f-42fb-80b3-a759428dddcb', 'c07a9c18-4232-40e2-9e43-b6140f869e0d', 'cfa433f9-0330-43c9-ade4-692a1b350f0b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:28 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:28 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:28 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c" returned: 0 in 0.567s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:28 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c Nov 03 17:11:28 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:28 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.338s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:28 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Deleted volume successfully. Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e664e21e-2f30-4c70-8317-3b01031a7979 tempest-VolumesTransfersV355Test-1308239127 None] Lock "cinder-ed71dad4-7dd3-4c42-a9b2-e9806b06a3a4-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:28 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2d8485-c751-4e1b-ab85-960cd03bd89c" returned: 0 in 0.328s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Lock "cinder-quobyte-ef2d8485-c751-4e1b-ab85-960cd03bd89c" released by "delete_volume" :: held 0.971s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Created reservations ['f4870711-32d5-44bd-a210-79f4fb9eb0cc', 'acb94d6a-bc26-4ab9-8b1d-293d4b6028d0', 'fa714854-6f3a-4909-ae46-15a10df4baa0', '95fc8c26-c7f7-4979-bec4-0f87e478584e'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:29 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:29 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:29 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.270s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:29 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:29 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Deleted volume successfully. Nov 03 17:11:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2b5d1e4c-c55e-40ca-83fc-afaede90bace tempest-TestMinimumBasicScenario-658004077 None] Lock "cinder-ef2d8485-c751-4e1b-ab85-960cd03bd89c-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:11:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:29 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:29 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:30 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.341s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:11:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:11:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:11:38 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=126,cinder:SELECT=97,cinder:DELETE=12,cinder:INSERT=34 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:11:39 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=149,cinder:SELECT=100,cinder:INSERT=34,cinder:DELETE=10 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Flow 'volume_create_manager' (5ad9591f-ceae-40f6-a2a4-8df0903df40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84e5997-244a-4024-b54e-5508dc2b6473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84e5997-244a-4024-b54e-5508dc2b6473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-14875937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f36a21-698c-4efc-bbfa-8660f1a50fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b672048e924bf8b66a6d030152aaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:45Z,use_quota=True,user_id='bf81e25fffca47d887820d4f66120f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a074d13b-fe4b-401c-ad2a-91d08069c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a074d13b-fe4b-401c-ad2a-91d08069c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d51b62-e36f-48a2-8e42-e389522f6974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d51b62-e36f-48a2-8e42-e389522f6974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f36a21-698c-4efc-bbfa-8660f1a50fc9', 'volume_name': 'volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acf6181-f12b-402f-b82a-caa3e9d0c881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acf6181-f12b-402f-b82a-caa3e9d0c881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152270ea-aff1-4262-85d4-a6786db1b7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:44 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Volume 37f36a21-698c-4efc-bbfa-8660f1a50fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9', 'volume_size': 1} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-14875937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f36a21-698c-4efc-bbfa-8660f1a50fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b672048e924bf8b66a6d030152aaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:45Z,use_quota=True,user_id='bf81e25fffca47d887820d4f66120f1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Creating volume 37f36a21-698c-4efc-bbfa-8660f1a50fc9 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:44 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:11:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:45 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 1073741824 Nov 03 17:11:45 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Flow 'volume_create_manager' (aad9b407-145f-4e12-9a0f-e2b3a96e0725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26944722-2116-4bd8-89a7-f5228977d135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26944722-2116-4bd8-89a7-f5228977d135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1606210340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7887e9-3061-4f1b-9efe-283987b6ac5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8360f26a2320428db38b1e1d4d232634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:45Z,use_quota=True,user_id='a1ed3b8ed05348008bd2ee44dbbf6ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd0cd7f-6937-4a4e-8096-a2467cd61536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd0cd7f-6937-4a4e-8096-a2467cd61536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c53b0bb-3a05-4c58-a52a-0f9a6a96ffe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.image.glance [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Creating Keystone auth plugin from conf {{(pid=86661) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c53b0bb-3a05-4c58-a52a-0f9a6a96ffe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a7887e9-3061-4f1b-9efe-283987b6ac5c', 'volume_name': 'volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c09306-e40e-4c1a-a0c5-517da9612473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c09306-e40e-4c1a-a0c5-517da9612473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcb76c0-ecc5-4946-895a-94d45b9e5afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:45 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Volume 7a7887e9-3061-4f1b-9efe-283987b6ac5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Trying to clone 7a7887e9-3061-4f1b-9efe-283987b6ac5c from image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]). {{(pid=86661) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:11:45 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 1073741824" returned: 0 in 0.779s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:45 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 Nov 03 17:11:45 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:45 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:11:45 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[72612cc0-2cb1-4d98-986e-94a624bfa531]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:46 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD Nov 03 17:11:46 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:46 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9" returned: 0 in 0.325s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (152270ea-aff1-4262-85d4-a6786db1b7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37f144f-2f58-43e0-ba83-a4c8c69cebf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:46 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Volume volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 (37f36a21-698c-4efc-bbfa-8660f1a50fc9): created successfully Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37f144f-2f58-43e0-ba83-a4c8c69cebf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Flow 'volume_create_manager' (5ad9591f-ceae-40f6-a2a4-8df0903df40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:46 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-378a7160-339f-4ffe-95f5-270e15942960 tempest-SnapshotMetadataTestJSON-2006164257 None] Created volume successfully. Nov 03 17:11:46 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Temporary image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 is fetched for user a1ed3b8ed05348008bd2ee44dbbf6ee1. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d608faa-e05c-4a1e-b4f8-05920bda0a6b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:46 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD Nov 03 17:11:46 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:46 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1606210340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7887e9-3061-4f1b-9efe-283987b6ac5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8360f26a2320428db38b1e1d4d232634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:45Z,use_quota=True,user_id='a1ed3b8ed05348008bd2ee44dbbf6ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Creating volume 7a7887e9-3061-4f1b-9efe-283987b6ac5c {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:47 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:47 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c 1073741824 Nov 03 17:11:47 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:47 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c 1073741824" returned: 0 in 0.576s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:47 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c Nov 03 17:11:47 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:47 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c" returned: 0 in 0.304s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.684s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] Creating offline snapshot 53edc564-ad6f-4b75-8d34-5bf2856a26bc of volume 37f36a21-698c-4efc-bbfa-8660f1a50fc9 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:11:48 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Attempting download of 4d6008ab-d7f4-4403-8d44-c7c2165d2356 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}])) to volume 7a7887e9-3061-4f1b-9efe-283987b6ac5c. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:11:48 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b9ddef-70a0-4165-b741-96fc2357646d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:48 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[28098b53-afe6-4604-88dd-0bf118b5f443]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_rsfxelc2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:48 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 Nov 03 17:11:48 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:48 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_rsfxelc2 Nov 03 17:11:48 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:48 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_rsfxelc2" returned: 0 in 0.430s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_rsfxelc2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:48 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9" returned: 0 in 0.525s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:48 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc 1G Nov 03 17:11:48 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:48 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_rsfxelc2 Nov 03 17:11:48 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:49 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_rsfxelc2" returned: 1 in 0.488s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_rsfxelc2' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:11:49 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4071d14-ba5d-4cc8-8ff3-d4afddab4c70]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:49 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD Nov 03 17:11:49 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:49 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc 1G" returned: 0 in 0.699s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:49 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc Nov 03 17:11:49 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:49 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:49 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] 4d6008ab-d7f4-4403-8d44-c7c2165d2356 was qcow2, converting to qcow2 {{(pid=86661) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:11:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:49 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c Nov 03 17:11:49 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:49 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc" returned: 0 in 0.603s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:49 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc is being set with open permissions: ugo+rw Nov 03 17:11:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:49 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc Nov 03 17:11:49 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:50 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc" returned: 0 in 0.342s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:50 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.info Nov 03 17:11:50 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:50 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.info" returned: 0 in 0.354s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:50 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.info is being set with open permissions: ugo+rw Nov 03 17:11:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:50 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.info Nov 03 17:11:50 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:51 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.info" returned: 0 in 0.447s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.107s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:51 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a2ee19d5-e976-4643-be1e-7693ff217ae9 tempest-SnapshotMetadataTestJSON-2006164257 None] Create snapshot completed successfully Nov 03 17:11:52 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c" returned: 0 in 2.970s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:52 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_aw3kel0ddevstack@QuobyteHD, size 112.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:11:52 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Converted 112.00 MB image at 37.70 MB/s Nov 03 17:11:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:52 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c 1G Nov 03 17:11:52 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:52 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c 1G" returned: 0 in 0.437s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:52 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Downloaded image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}])) to volume 7a7887e9-3061-4f1b-9efe-283987b6ac5c successfully. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:11:52 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Temporary image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 for user a1ed3b8ed05348008bd2ee44dbbf6ee1 is deleted. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:11:52 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Marking volume 7a7887e9-3061-4f1b-9efe-283987b6ac5c as bootable. {{(pid=86661) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:11:52 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Copying metadata from image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 to 7a7887e9-3061-4f1b-9efe-283987b6ac5c. {{(pid=86661) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:11:52 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Creating volume glance metadata for volume 7a7887e9-3061-4f1b-9efe-283987b6ac5c backed by image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86661) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcb76c0-ecc5-4946-895a-94d45b9e5afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf3d554-6895-464b-88c9-6401d92792bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Acquiring lock "cinder-53edc564-ad6f-4b75-8d34-5bf2856a26bc-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:53 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Volume volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c (7a7887e9-3061-4f1b-9efe-283987b6ac5c): created successfully Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf3d554-6895-464b-88c9-6401d92792bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Flow 'volume_create_manager' (aad9b407-145f-4e12-9a0f-e2b3a96e0725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:53 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-bd184e18-771b-4911-87e7-12a2b3e27e71 tempest-VolumesExtendTest-1047830087 None] Created volume successfully. Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "cinder-53edc564-ad6f-4b75-8d34-5bf2856a26bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Acquiring lock "cinder-quobyte-37f36a21-698c-4efc-bbfa-8660f1a50fc9" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "cinder-quobyte-37f36a21-698c-4efc-bbfa-8660f1a50fc9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Acquiring lock "cinder-quobyte-53edc564-ad6f-4b75-8d34-5bf2856a26bc" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "cinder-quobyte-53edc564-ad6f-4b75-8d34-5bf2856a26bc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Deleting offline snapshot 53edc564-ad6f-4b75-8d34-5bf2856a26bc of volume 37f36a21-698c-4efc-bbfa-8660f1a50fc9 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] snapshot_file for this snap is: volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d32819b-26de-47b1-b35b-4bf2d2d96716]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:53 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc Nov 03 17:11:53 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7496ffcd-8f45-47d9-aada-c1b439034f61 tempest-VolumesExtendTest-1047830087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7496ffcd-8f45-47d9-aada-c1b439034f61 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:53 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc" returned: 0 in 0.583s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[4345c73d-e39e-4cd7-8518-6941fb34bcca]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7496ffcd-8f45-47d9-aada-c1b439034f61 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[356e7d4d-c11b-4e4e-9a70-a48d95dc2162]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:54 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 Nov 03 17:11:54 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:54 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c Nov 03 17:11:54 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:54 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7496ffcd-8f45-47d9-aada-c1b439034f61 tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c" returned: 0 in 0.549s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7496ffcd-8f45-47d9-aada-c1b439034f61 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c 2G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:54 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9" returned: 0 in 0.585s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:54 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc Nov 03 17:11:54 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7496ffcd-8f45-47d9-aada-c1b439034f61 tempest-VolumesExtendTest-1047830087 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c 2G" returned: 0 in 0.183s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7496ffcd-8f45-47d9-aada-c1b439034f61 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.805s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:54 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7496ffcd-8f45-47d9-aada-c1b439034f61 tempest-VolumesExtendTest-1047830087 None] Extend volume completed successfully. Nov 03 17:11:55 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc" returned: 0 in 0.567s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:55 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc Nov 03 17:11:55 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:55 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9.53edc564-ad6f-4b75-8d34-5bf2856a26bc" returned: 0 in 0.330s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "cinder-quobyte-53edc564-ad6f-4b75-8d34-5bf2856a26bc" released by "_delete_snapshot" :: held 2.243s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "cinder-quobyte-37f36a21-698c-4efc-bbfa-8660f1a50fc9" released by "delete_snapshot" :: held 2.272s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Created reservations ['4975fbdb-f24e-4bdf-92ec-96865f4fd5b0', '58290a35-7fb1-4528-950c-c946b64d09c9', '86589a3e-cc96-4e5c-bb01-082d1521d468', '0ee2700f-53d4-4335-8d66-c2c2431d34ee'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Acquiring lock "cinder-7a7887e9-3061-4f1b-9efe-283987b6ac5c-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Lock "cinder-7a7887e9-3061-4f1b-9efe-283987b6ac5c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:55 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Delete snapshot completed successfully. Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e900b23f-c82f-40da-a045-6530d9ac96ab tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "cinder-53edc564-ad6f-4b75-8d34-5bf2856a26bc-delete_snapshot" released by "delete_snapshot" :: held 2.582s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Acquiring lock "cinder-quobyte-7a7887e9-3061-4f1b-9efe-283987b6ac5c" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Lock "cinder-quobyte-7a7887e9-3061-4f1b-9efe-283987b6ac5c" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[78676175-4f60-4626-97b7-c328c92bdd09]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:56 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c Nov 03 17:11:56 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:56 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c" returned: 0 in 0.556s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Acquiring lock "cinder-37f36a21-698c-4efc-bbfa-8660f1a50fc9-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:56 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c Nov 03 17:11:56 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "cinder-37f36a21-698c-4efc-bbfa-8660f1a50fc9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Acquiring lock "cinder-quobyte-37f36a21-698c-4efc-bbfa-8660f1a50fc9" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:11:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "cinder-quobyte-37f36a21-698c-4efc-bbfa-8660f1a50fc9" acquired by "delete_volume" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:11:56 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f463207-1ac8-4444-8f4b-ac50f9eb41b7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:11:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:56 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 Nov 03 17:11:56 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:56 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7a7887e9-3061-4f1b-9efe-283987b6ac5c" returned: 0 in 0.401s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Lock "cinder-quobyte-7a7887e9-3061-4f1b-9efe-283987b6ac5c" released by "delete_volume" :: held 1.048s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:56 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Created reservations ['6683924d-100d-4eb4-8f6b-b006954f911b', '683f3d51-aea5-4682-8532-e7c5793c2834', 'fda8cabc-9592-4adc-8c00-7e032b87ddfb', '6fe133cb-97f1-4f0d-aa7d-c00f8148f2ae'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:57 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:57 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:57 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9" returned: 0 in 0.482s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:57 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9 Nov 03 17:11:57 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:57 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.296s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:57 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Deleted volume successfully. Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-692533f5-9314-4746-ad96-89507e9249c1 tempest-VolumesExtendTest-1047830087 None] Lock "cinder-7a7887e9-3061-4f1b-9efe-283987b6ac5c-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:57 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-37f36a21-698c-4efc-bbfa-8660f1a50fc9" returned: 0 in 0.299s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "cinder-quobyte-37f36a21-698c-4efc-bbfa-8660f1a50fc9" released by "delete_volume" :: held 0.858s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Created reservations ['2891f305-9ec6-47d5-9dce-16f1ae156e74', '2f6a5879-d875-4f4a-af77-13a8cc50498f', 'cc08c731-2319-4e30-9d42-8cdf4f6f4ca9', '0f5b7ec3-06fa-4572-b187-efaef293ad74'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:57 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:11:57 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:57 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.360s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:57 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:11:57 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Deleted volume successfully. Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bc666267-c56e-4868-a872-2a94eb6e6398 tempest-SnapshotMetadataTestJSON-2006164257 None] Lock "cinder-37f36a21-698c-4efc-bbfa-8660f1a50fc9-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Flow 'volume_create_manager' (187db893-cb64-4959-b755-8447fbcad917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed05f846-e493-4904-ab57-97f9d1eaa922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed05f846-e493-4904-ab57-97f9d1eaa922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-210784946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce6261f-d696-421b-93da-09d396683226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8360f26a2320428db38b1e1d4d232634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:59Z,use_quota=True,user_id='a1ed3b8ed05348008bd2ee44dbbf6ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094a6f80-df3b-4dd5-bf8b-20a45aec1b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (094a6f80-df3b-4dd5-bf8b-20a45aec1b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fe86c6-2917-4462-b1c0-0166ebec9d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fe86c6-2917-4462-b1c0-0166ebec9d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fce6261f-d696-421b-93da-09d396683226', 'volume_name': 'volume-fce6261f-d696-421b-93da-09d396683226', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64ba348-e7d1-4e40-9373-5f5836ae7fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64ba348-e7d1-4e40-9373-5f5836ae7fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c21bfb-4df0-428a-85be-085c48983553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:58 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Volume fce6261f-d696-421b-93da-09d396683226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fce6261f-d696-421b-93da-09d396683226', 'volume_size': 1} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-210784946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce6261f-d696-421b-93da-09d396683226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8360f26a2320428db38b1e1d4d232634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:11:59Z,use_quota=True,user_id='a1ed3b8ed05348008bd2ee44dbbf6ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Creating volume fce6261f-d696-421b-93da-09d396683226 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:11:58 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:11:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:58 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 1073741824 Nov 03 17:11:58 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:59 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 1073741824" returned: 0 in 0.634s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:11:59 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 Nov 03 17:11:59 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:11:59 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Nov 03 17:11:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226" returned: 0 in 0.391s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:11:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:11:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:11:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c21bfb-4df0-428a-85be-085c48983553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fce6261f-d696-421b-93da-09d396683226', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f298bde-e585-42e1-972e-bad6e589c5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:11:59 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Volume volume-fce6261f-d696-421b-93da-09d396683226 (fce6261f-d696-421b-93da-09d396683226): created successfully Nov 03 17:11:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f298bde-e585-42e1-972e-bad6e589c5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:11:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Flow 'volume_create_manager' (187db893-cb64-4959-b755-8447fbcad917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:11:59 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-cc500f04-3ee9-4f41-a210-a3356f31b54e tempest-VolumesExtendTest-1047830087 None] Created volume successfully. Nov 03 17:12:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] Creating offline snapshot e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 of volume fce6261f-d696-421b-93da-09d396683226 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:12:01 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d1d6f5-d602-4f3d-9d89-950b8e5b9569]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:01 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 Nov 03 17:12:01 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:01 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226" returned: 0 in 0.575s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:01 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 1G Nov 03 17:12:01 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:02 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 1G" returned: 0 in 0.608s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fce6261f-d696-421b-93da-09d396683226 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:02 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fce6261f-d696-421b-93da-09d396683226 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 Nov 03 17:12:02 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:02 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fce6261f-d696-421b-93da-09d396683226 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6" returned: 0 in 0.377s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:02 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 is being set with open permissions: ugo+rw Nov 03 17:12:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:02 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 Nov 03 17:12:02 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:03 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6" returned: 0 in 0.339s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:03 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.info Nov 03 17:12:03 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Flow 'volume_create_manager' (2a9d91ba-c3d3-4930-8264-e70e0f72a9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06493ef-f329-4732-a31a-e53335d7c8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06493ef-f329-4732-a31a-e53335d7c8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1192630112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36567e1b-0784-4052-989f-6051fdfa6028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f46c9ed1a541ada29b918a27bb149e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:03Z,use_quota=True,user_id='88520e24aa0f42318aa979212a15aac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbafc9e2-6c1f-44ab-981d-0a98ffe89ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbafc9e2-6c1f-44ab-981d-0a98ffe89ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ffc8e5-2886-4929-8a84-e02c02060b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ffc8e5-2886-4929-8a84-e02c02060b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36567e1b-0784-4052-989f-6051fdfa6028', 'volume_name': 'volume-36567e1b-0784-4052-989f-6051fdfa6028', 'volume_size': 2}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601ab32c-56c1-4eaf-9b82-6253e299a36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (601ab32c-56c1-4eaf-9b82-6253e299a36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97bc5be-a614-42a6-8db0-254758f882ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:03 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:03 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Volume 36567e1b-0784-4052-989f-6051fdfa6028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36567e1b-0784-4052-989f-6051fdfa6028', 'volume_size': 2} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.info" returned: 0 in 0.488s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:03 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.info is being set with open permissions: ugo+rw Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:03 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.info Nov 03 17:12:03 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:03 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.info" returned: 0 in 0.286s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.798s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.320s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1192630112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36567e1b-0784-4052-989f-6051fdfa6028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f46c9ed1a541ada29b918a27bb149e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:03Z,use_quota=True,user_id='88520e24aa0f42318aa979212a15aac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Creating volume 36567e1b-0784-4052-989f-6051fdfa6028 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:04 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028 2147483648 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:04 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028 2147483648 Nov 03 17:12:04 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-73607b03-fad2-4ae8-9264-53515e8e7248 tempest-VolumesExtendTest-1047830087 None] Create snapshot completed successfully Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-746dfef3-ddec-412c-8d02-e12df0551f00 tempest-VolumesExtendTest-1047830087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:04 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028 2147483648" returned: 0 in 0.714s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:04 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028 Nov 03 17:12:04 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:05 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028" returned: 0 in 0.354s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-746dfef3-ddec-412c-8d02-e12df0551f00 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.480s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97bc5be-a614-42a6-8db0-254758f882ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36567e1b-0784-4052-989f-6051fdfa6028', 'volume_size': 2}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44601152-3db8-4d93-8cf5-4b7600badf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e7e0f7-862e-43e1-8472-505bfb16b786]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-746dfef3-ddec-412c-8d02-e12df0551f00 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:05 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Volume volume-36567e1b-0784-4052-989f-6051fdfa6028 (36567e1b-0784-4052-989f-6051fdfa6028): created successfully Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44601152-3db8-4d93-8cf5-4b7600badf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Flow 'volume_create_manager' (2a9d91ba-c3d3-4930-8264-e70e0f72a9df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:05 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-343e8033-31c9-473b-8f6c-d595f743d724 tempest-VolumesCloneNegativeTest-1177220716 None] Created volume successfully. Nov 03 17:12:05 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 Nov 03 17:12:05 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:05 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-746dfef3-ddec-412c-8d02-e12df0551f00 tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226" returned: 0 in 0.474s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-746dfef3-ddec-412c-8d02-e12df0551f00 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 2G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-746dfef3-ddec-412c-8d02-e12df0551f00 tempest-VolumesExtendTest-1047830087 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 2G" returned: 0 in 0.246s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-746dfef3-ddec-412c-8d02-e12df0551f00 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.807s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Acquiring lock "cinder-36567e1b-0784-4052-989f-6051fdfa6028-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:06 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-746dfef3-ddec-412c-8d02-e12df0551f00 tempest-VolumesExtendTest-1047830087 None] Extend volume completed successfully. Nov 03 17:12:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Lock "cinder-36567e1b-0784-4052-989f-6051fdfa6028-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Acquiring lock "cinder-quobyte-36567e1b-0784-4052-989f-6051fdfa6028" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Lock "cinder-quobyte-36567e1b-0784-4052-989f-6051fdfa6028" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:06 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc043d2f-d87b-49a0-b3ff-3666cd6b5009]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:06 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028 Nov 03 17:12:06 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:06 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028" returned: 0 in 0.769s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:07 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028 Nov 03 17:12:07 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Acquiring lock "cinder-e86e0d3e-f08c-4bc7-995b-79de4c1cbff6-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Lock "cinder-e86e0d3e-f08c-4bc7-995b-79de4c1cbff6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Acquiring lock "cinder-quobyte-fce6261f-d696-421b-93da-09d396683226" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Lock "cinder-quobyte-fce6261f-d696-421b-93da-09d396683226" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Acquiring lock "cinder-quobyte-e86e0d3e-f08c-4bc7-995b-79de4c1cbff6" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Lock "cinder-quobyte-e86e0d3e-f08c-4bc7-995b-79de4c1cbff6" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Deleting offline snapshot e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 of volume fce6261f-d696-421b-93da-09d396683226 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] snapshot_file for this snap is: volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b3c4ae-74fd-4cb1-a2ee-cc8b90021e30]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:07 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 Nov 03 17:12:07 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:07 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-36567e1b-0784-4052-989f-6051fdfa6028" returned: 0 in 0.845s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Lock "cinder-quobyte-36567e1b-0784-4052-989f-6051fdfa6028" released by "delete_volume" :: held 1.727s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:08 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6" returned: 0 in 0.721s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fce6261f-d696-421b-93da-09d396683226(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:12:08 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d10ccef-78e3-4a46-945d-d82dd0b93bbe]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:08 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Created reservations ['62fabd5d-2afe-4fe7-86ad-3ae3cdf6293a', 'a8656a82-6f3a-466d-93a8-383695b8f6be', 'dd56001d-11ef-40ea-a4e4-217d09c61a19', 'b1376b8a-2092-495d-9437-8cc6c706c2f1'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:08 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 Nov 03 17:12:08 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:08 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:12:08 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:09 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.792s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:09 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Deleted volume successfully. Nov 03 17:12:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2854351b-752b-4585-a7ac-37b4c479af15 tempest-VolumesCloneNegativeTest-1177220716 None] Lock "cinder-36567e1b-0784-4052-989f-6051fdfa6028-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226" returned: 0 in 1.213s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:09 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:09 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 Nov 03 17:12:09 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:10 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6" returned: 0 in 0.679s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:10 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6 Nov 03 17:12:10 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:10 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226.e86e0d3e-f08c-4bc7-995b-79de4c1cbff6" returned: 0 in 0.303s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Lock "cinder-quobyte-e86e0d3e-f08c-4bc7-995b-79de4c1cbff6" released by "_delete_snapshot" :: held 3.123s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Lock "cinder-quobyte-fce6261f-d696-421b-93da-09d396683226" released by "delete_snapshot" :: held 3.179s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:11 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Created reservations ['3398d382-e664-4322-b61d-d57cb3be931c', 'ef196f86-aa5f-4105-9d08-e910af06d201', '325484ea-aa65-44ab-ba82-47fc5fa41255', 'ba4f120b-64c9-4ca6-aabb-df313b08660e'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:14 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Delete snapshot completed successfully. Nov 03 17:12:14 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-41da1a1a-ef4b-492e-a2f3-591a4735fb3f tempest-VolumesExtendTest-1047830087 None] Lock "cinder-e86e0d3e-f08c-4bc7-995b-79de4c1cbff6-delete_snapshot" released by "delete_snapshot" :: held 7.591s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:14 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Acquiring lock "cinder-fce6261f-d696-421b-93da-09d396683226-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Lock "cinder-fce6261f-d696-421b-93da-09d396683226-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Acquiring lock "cinder-quobyte-fce6261f-d696-421b-93da-09d396683226" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Lock "cinder-quobyte-fce6261f-d696-421b-93da-09d396683226" acquired by "delete_volume" :: waited 0.043s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:15 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[3551ef5b-b54d-4ed1-a1d0-843d415e30b4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:15 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 Nov 03 17:12:15 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:15 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226" returned: 0 in 0.684s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:15 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226 Nov 03 17:12:15 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:16 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fce6261f-d696-421b-93da-09d396683226" returned: 0 in 0.382s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Lock "cinder-quobyte-fce6261f-d696-421b-93da-09d396683226" released by "delete_volume" :: held 1.193s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:16 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Created reservations ['b4f54f61-7239-45c1-bfa8-0162efcbd31e', 'a9dd80d0-1ee2-44fc-8db3-8539d535c1d8', 'adcbbb54-2fce-4d32-937b-35c116e2833e', '2e190f89-3093-43f5-a8ea-77fa7d53ca18'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:16 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:12:16 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:16 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.450s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:16 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:16 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Deleted volume successfully. Nov 03 17:12:17 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a66241b5-8dad-4ca6-b09d-efbb250bc261 tempest-VolumesExtendTest-1047830087 None] Lock "cinder-fce6261f-d696-421b-93da-09d396683226-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Flow 'volume_create_manager' (65c18020-a22d-4d31-b9bd-20fccf2107d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9291e13a-911a-42c4-8968-b628ee6d6d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9291e13a-911a-42c4-8968-b628ee6d6d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-616070083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e835521e-60a7-43c6-a240-de7463d56852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc551554d924eaf9c1e74733434e4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:21Z,use_quota=True,user_id='ba9b5346ae484b158da477812fd13687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804a1fe4-06c3-4b21-ab3f-db30b826f3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804a1fe4-06c3-4b21-ab3f-db30b826f3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2984e985-e260-46e5-ab17-3d81f28888c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2984e985-e260-46e5-ab17-3d81f28888c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e835521e-60a7-43c6-a240-de7463d56852', 'volume_name': 'volume-e835521e-60a7-43c6-a240-de7463d56852', 'volume_size': 2}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a33169-3202-41fc-ba25-f8ee938ee3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a33169-3202-41fc-ba25-f8ee938ee3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bfb77e-f401-4aee-a846-69de84f75dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:21 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Volume e835521e-60a7-43c6-a240-de7463d56852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e835521e-60a7-43c6-a240-de7463d56852', 'volume_size': 2} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-616070083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e835521e-60a7-43c6-a240-de7463d56852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc551554d924eaf9c1e74733434e4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:21Z,use_quota=True,user_id='ba9b5346ae484b158da477812fd13687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Creating volume e835521e-60a7-43c6-a240-de7463d56852 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:21 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:12:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 2147483648 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:21 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 2147483648 Nov 03 17:12:21 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:22 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 2147483648" returned: 0 in 0.698s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:22 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 Nov 03 17:12:22 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:22 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852" returned: 0 in 0.306s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bfb77e-f401-4aee-a846-69de84f75dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e835521e-60a7-43c6-a240-de7463d56852', 'volume_size': 2}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b637682-a7fb-440b-89f2-6fd62cca2f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:22 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Volume volume-e835521e-60a7-43c6-a240-de7463d56852 (e835521e-60a7-43c6-a240-de7463d56852): created successfully Nov 03 17:12:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b637682-a7fb-440b-89f2-6fd62cca2f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Flow 'volume_create_manager' (65c18020-a22d-4d31-b9bd-20fccf2107d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2ca19dfc-751e-48ff-b260-826728606733 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Created volume successfully. Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Flow 'volume_create_manager' (c23771fe-5cde-4b72-9cfc-810668916470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a69115-d9ff-4d07-9f3b-25480045f4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a69115-d9ff-4d07-9f3b-25480045f4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-759950025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162c269d-089c-40b0-93ad-8725a8211a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='448e7444ec21426c80dc32017e94351f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:23Z,use_quota=True,user_id='fe32049f67b04f04b5a1896167cdb6e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5949c9f4-87f2-4e55-a18c-4a739b91f670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5949c9f4-87f2-4e55-a18c-4a739b91f670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9ba2f5-a391-440c-b06d-ac3a6e89b594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9ba2f5-a391-440c-b06d-ac3a6e89b594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '162c269d-089c-40b0-93ad-8725a8211a05', 'volume_name': 'volume-162c269d-089c-40b0-93ad-8725a8211a05', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36c77b9-2c0c-4b3a-acdc-0e9faedf45d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36c77b9-2c0c-4b3a-acdc-0e9faedf45d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ec8c2e-a55f-4f1c-a734-faaad5d5a882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:23 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Volume 162c269d-089c-40b0-93ad-8725a8211a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-162c269d-089c-40b0-93ad-8725a8211a05', 'volume_size': 1} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-759950025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162c269d-089c-40b0-93ad-8725a8211a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='448e7444ec21426c80dc32017e94351f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:23Z,use_quota=True,user_id='fe32049f67b04f04b5a1896167cdb6e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Creating volume 162c269d-089c-40b0-93ad-8725a8211a05 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:23 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:23 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05 1073741824 Nov 03 17:12:23 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:23 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05 1073741824" returned: 0 in 0.588s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:23 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05 Nov 03 17:12:23 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:24 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05" returned: 0 in 0.258s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.476s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ec8c2e-a55f-4f1c-a734-faaad5d5a882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162c269d-089c-40b0-93ad-8725a8211a05', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b92db8-386f-455f-abe7-0298516f9b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Creating offline snapshot 54a2f254-910c-434b-9294-24aa9989fd39 of volume e835521e-60a7-43c6-a240-de7463d56852 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:12:24 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Volume volume-162c269d-089c-40b0-93ad-8725a8211a05 (162c269d-089c-40b0-93ad-8725a8211a05): created successfully Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b92db8-386f-455f-abe7-0298516f9b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Flow 'volume_create_manager' (c23771fe-5cde-4b72-9cfc-810668916470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e980e2-977e-4fda-a74c-5785eded4218]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f78694e4-654e-4860-b450-06f1feaf39f4 tempest-VolumesNegativeTest-253584638 None] Created volume successfully. Nov 03 17:12:24 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 Nov 03 17:12:24 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:24 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852" returned: 0 in 0.422s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 2G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:24 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 2G Nov 03 17:12:24 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:24 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 2G" returned: 0 in 0.429s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e835521e-60a7-43c6-a240-de7463d56852 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:25 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e835521e-60a7-43c6-a240-de7463d56852 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 Nov 03 17:12:25 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:25 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e835521e-60a7-43c6-a240-de7463d56852 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39" returned: 0 in 0.351s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:25 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 is being set with open permissions: ugo+rw Nov 03 17:12:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:25 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 Nov 03 17:12:25 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:25 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39" returned: 0 in 0.304s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:25 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.info Nov 03 17:12:25 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:26 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.info" returned: 0 in 0.327s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:26 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.info is being set with open permissions: ugo+rw Nov 03 17:12:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:26 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.info Nov 03 17:12:26 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:26 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.info" returned: 0 in 0.353s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.327s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:26 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-bf1a3437-6d05-4861-a35a-1f1e9016d4c8 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Create snapshot completed successfully Nov 03 17:12:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Acquiring lock "cinder-54a2f254-910c-434b-9294-24aa9989fd39-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "cinder-54a2f254-910c-434b-9294-24aa9989fd39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Acquiring lock "cinder-quobyte-e835521e-60a7-43c6-a240-de7463d56852" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "cinder-quobyte-e835521e-60a7-43c6-a240-de7463d56852" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Acquiring lock "cinder-quobyte-54a2f254-910c-434b-9294-24aa9989fd39" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "cinder-quobyte-54a2f254-910c-434b-9294-24aa9989fd39" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Deleting offline snapshot 54a2f254-910c-434b-9294-24aa9989fd39 of volume e835521e-60a7-43c6-a240-de7463d56852 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:12:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] snapshot_file for this snap is: volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:12:27 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cda199-eef7-4a51-a733-a1819ec8ae38]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:27 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 Nov 03 17:12:27 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:27 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39" returned: 0 in 0.594s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e835521e-60a7-43c6-a240-de7463d56852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:12:27 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[d868cf16-3e47-4ea1-9e60-22c2ffc18da8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:27 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 Nov 03 17:12:27 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:28 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852" returned: 0 in 0.595s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:28 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 Nov 03 17:12:28 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:28 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39" returned: 0 in 0.500s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:28 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39 Nov 03 17:12:28 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:29 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852.54a2f254-910c-434b-9294-24aa9989fd39" returned: 0 in 0.454s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "cinder-quobyte-54a2f254-910c-434b-9294-24aa9989fd39" released by "_delete_snapshot" :: held 2.468s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "cinder-quobyte-e835521e-60a7-43c6-a240-de7463d56852" released by "delete_snapshot" :: held 2.508s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Flow 'volume_create_manager' (16ed4c31-0931-41bb-8ceb-d6548f510559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f1ce40-189c-4332-a78d-19c9b7158e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f1ce40-189c-4332-a78d-19c9b7158e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-205574114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d28c5e4-7496-4a92-9b52-6d9f3cac5b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348b220e6e3f4df4a0a781e4f757dda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:29Z,use_quota=True,user_id='33d13f98be494e2ea060ce32537847d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ad2f92-0d79-42a4-bb5f-dfa3bfb3d9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ad2f92-0d79-42a4-bb5f-dfa3bfb3d9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99508167-0a18-4ee7-9edc-118be59cba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99508167-0a18-4ee7-9edc-118be59cba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d28c5e4-7496-4a92-9b52-6d9f3cac5b02', 'volume_name': 'volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77a7479-52ff-4b8a-9376-2dec47f91995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77a7479-52ff-4b8a-9376-2dec47f91995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d475384e-2e24-4940-9a7a-bb45886f5782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:29 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Volume 0d28c5e4-7496-4a92-9b52-6d9f3cac5b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02', 'volume_size': 1} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-205574114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d28c5e4-7496-4a92-9b52-6d9f3cac5b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348b220e6e3f4df4a0a781e4f757dda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:29Z,use_quota=True,user_id='33d13f98be494e2ea060ce32537847d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Creating volume 0d28c5e4-7496-4a92-9b52-6d9f3cac5b02 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:29 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:29 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02 1073741824 Nov 03 17:12:29 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Created reservations ['0ebf1bff-b477-40e4-bca6-b078055fc242', 'c17da39f-fb26-4329-96c3-091e65605665', 'cd44a01f-acc1-4ead-b23f-f7ac0bedf3c4', 'f65f3ba0-513c-4d2d-b04d-5e53a4491062'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:29 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:12:29 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:29 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Delete snapshot completed successfully. Nov 03 17:12:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42935bc1-b844-473d-ae69-04ad37b57993 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "cinder-54a2f254-910c-434b-9294-24aa9989fd39-delete_snapshot" released by "delete_snapshot" :: held 3.006s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:30 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.663s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Flow 'volume_create_manager' (aa526fe1-e99f-4807-a48b-f1775af3d7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2668483a-d78b-4db8-94db-e1c89c55345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Acquiring lock "cinder-e835521e-60a7-43c6-a240-de7463d56852-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2668483a-d78b-4db8-94db-e1c89c55345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-414930282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7157f306-b8df-42cb-8227-3781be9ce949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348b220e6e3f4df4a0a781e4f757dda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:30Z,use_quota=True,user_id='33d13f98be494e2ea060ce32537847d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c070f55-bc85-492d-b017-a8a877a826f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c070f55-bc85-492d-b017-a8a877a826f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305160d9-93d9-4003-b153-a81bec198d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305160d9-93d9-4003-b153-a81bec198d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7157f306-b8df-42cb-8227-3781be9ce949', 'volume_name': 'volume-7157f306-b8df-42cb-8227-3781be9ce949', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e121d1b-5b86-4726-bc51-6817f924032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e121d1b-5b86-4726-bc51-6817f924032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:30 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14432635-8aeb-4054-bb9f-8532793ca01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:30 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Volume 7157f306-b8df-42cb-8227-3781be9ce949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7157f306-b8df-42cb-8227-3781be9ce949', 'volume_size': 1} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "cinder-e835521e-60a7-43c6-a240-de7463d56852-delete_volume" acquired by "delete_volume" :: waited 0.146s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02 1073741824" returned: 0 in 1.040s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Acquiring lock "cinder-quobyte-e835521e-60a7-43c6-a240-de7463d56852" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:30 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02 Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "cinder-quobyte-e835521e-60a7-43c6-a240-de7463d56852" acquired by "delete_volume" :: waited 0.073s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:30 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[221c280c-ef9f-4070-bdeb-111e754268e3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:31 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 Nov 03 17:12:31 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:31 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02" returned: 0 in 0.559s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-414930282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7157f306-b8df-42cb-8227-3781be9ce949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348b220e6e3f4df4a0a781e4f757dda4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:30Z,use_quota=True,user_id='33d13f98be494e2ea060ce32537847d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Creating volume 7157f306-b8df-42cb-8227-3781be9ce949 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:31 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d475384e-2e24-4940-9a7a-bb45886f5782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0e6f86-c8dd-48c1-873e-3f30ef0230a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:31 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949 1073741824 Nov 03 17:12:31 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:31 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Volume volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02 (0d28c5e4-7496-4a92-9b52-6d9f3cac5b02): created successfully Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0e6f86-c8dd-48c1-873e-3f30ef0230a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Flow 'volume_create_manager' (16ed4c31-0931-41bb-8ceb-d6548f510559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:31 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-721e9602-2ed0-4bdb-b9cb-c7dd4e571135 tempest-TestServerVolumeAttachmentScenario-497544685 None] Created volume successfully. Nov 03 17:12:31 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852" returned: 0 in 0.513s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:31 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852 Nov 03 17:12:31 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:31 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e835521e-60a7-43c6-a240-de7463d56852" returned: 0 in 0.350s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "cinder-quobyte-e835521e-60a7-43c6-a240-de7463d56852" released by "delete_volume" :: held 1.010s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Created reservations ['505b5a4d-df6d-4474-b39b-fe36ed33a4ea', '369e0781-c970-4f28-a6d2-d270efbc2e3d', 'd66cc257-89ab-4286-bd3b-3b4cd657dde0', '20b85fad-fcad-44ce-b9d1-c4fa14810ea0'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:31 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949 1073741824" returned: 0 in 0.635s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:32 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:12:32 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:32 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949 Nov 03 17:12:32 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:32 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.314s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:32 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Deleted volume successfully. Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fb193c9f-ea86-4c09-b34f-921da58c05d4 tempest-VolumesSnapshotNegativeTestJSON-613203088 None] Lock "cinder-e835521e-60a7-43c6-a240-de7463d56852-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:32 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949" returned: 0 in 0.328s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14432635-8aeb-4054-bb9f-8532793ca01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7157f306-b8df-42cb-8227-3781be9ce949', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112441fc-a7da-4521-a494-5cd512e063c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:32 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Volume volume-7157f306-b8df-42cb-8227-3781be9ce949 (7157f306-b8df-42cb-8227-3781be9ce949): created successfully Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112441fc-a7da-4521-a494-5cd512e063c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Flow 'volume_create_manager' (aa526fe1-e99f-4807-a48b-f1775af3d7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:32 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1a6b2d30-50fd-4f58-95b0-e612a622a1fe tempest-TestServerVolumeAttachmentScenario-497544685 None] Created volume successfully. Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Flow 'volume_create_manager' (29d1344e-b570-46d2-bb75-1f8811258ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb6ec9e-0fcd-422f-a605-8dc372d6a49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb6ec9e-0fcd-422f-a605-8dc372d6a49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1048408125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e403d8c-027e-4994-a359-0b94844d0e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1c75810eb948dfb87330693b7008c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:37Z,use_quota=True,user_id='6ae0e582b0394bca8dc326bc22812346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d73725-1ba4-44ad-a698-5363654a1cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d73725-1ba4-44ad-a698-5363654a1cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c6b11f-df27-47dd-973b-e43ab054cc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c6b11f-df27-47dd-973b-e43ab054cc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e403d8c-027e-4994-a359-0b94844d0e3c', 'volume_name': 'volume-2e403d8c-027e-4994-a359-0b94844d0e3c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82499ce-30d4-4cad-a214-a1807f0830c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82499ce-30d4-4cad-a214-a1807f0830c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25748e2-228d-43fb-9e7d-39b34c2ef646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:37 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Volume 2e403d8c-027e-4994-a359-0b94844d0e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e403d8c-027e-4994-a359-0b94844d0e3c', 'volume_size': 1} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1048408125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e403d8c-027e-4994-a359-0b94844d0e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1c75810eb948dfb87330693b7008c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:12:37Z,use_quota=True,user_id='6ae0e582b0394bca8dc326bc22812346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Creating volume 2e403d8c-027e-4994-a359-0b94844d0e3c {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:12:37 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:12:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:37 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c 1073741824 Nov 03 17:12:37 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:38 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c 1073741824" returned: 0 in 0.715s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:38 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c Nov 03 17:12:38 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:38 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c" returned: 0 in 0.412s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:12:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25748e2-228d-43fb-9e7d-39b34c2ef646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e403d8c-027e-4994-a359-0b94844d0e3c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3552a7ce-adfe-4bd5-be09-577c100a15a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:12:38 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Volume volume-2e403d8c-027e-4994-a359-0b94844d0e3c (2e403d8c-027e-4994-a359-0b94844d0e3c): created successfully Nov 03 17:12:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3552a7ce-adfe-4bd5-be09-577c100a15a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:12:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Flow 'volume_create_manager' (29d1344e-b570-46d2-bb75-1f8811258ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:12:38 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-22fdb536-396e-4161-af9b-562c17589830 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Created volume successfully. Nov 03 17:12:40 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=84,cinder:UPDATE=98,cinder:DELETE=11,cinder:INSERT=23 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:12:40 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=91,cinder:SELECT=79,cinder:INSERT=34,cinder:DELETE=6 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:12:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-19face6e-d36e-49f4-b03f-5680754a0ee4 req-f42b5c27-1672-46c8-bd9e-c088a1987047 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-19face6e-d36e-49f4-b03f-5680754a0ee4 req-f42b5c27-1672-46c8-bd9e-c088a1987047 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-19face6e-d36e-49f4-b03f-5680754a0ee4 req-f42b5c27-1672-46c8-bd9e-c088a1987047 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-19face6e-d36e-49f4-b03f-5680754a0ee4 req-f42b5c27-1672-46c8-bd9e-c088a1987047 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-2e403d8c-027e-4994-a359-0b94844d0e3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6c1425d-4065-4b44-a6c4-6cee9444dc44', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:12:40 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-19face6e-d36e-49f4-b03f-5680754a0ee4 req-f42b5c27-1672-46c8-bd9e-c088a1987047 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] attachment_update completed successfully. Nov 03 17:12:45 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-2ec89664-4e3e-4476-bc79-151fa41b9226 req-6d133e1d-9fbd-4617-b66f-3f21de8a0961 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Terminate volume connection completed successfully. Nov 03 17:12:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-2ec89664-4e3e-4476-bc79-151fa41b9226 req-6d133e1d-9fbd-4617-b66f-3f21de8a0961 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Deleting attachment e6c1425d-4065-4b44-a6c4-6cee9444dc44. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:12:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Acquiring lock "cinder-2e403d8c-027e-4994-a359-0b94844d0e3c-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "cinder-2e403d8c-027e-4994-a359-0b94844d0e3c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Acquiring lock "cinder-quobyte-2e403d8c-027e-4994-a359-0b94844d0e3c" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "cinder-quobyte-2e403d8c-027e-4994-a359-0b94844d0e3c" acquired by "delete_volume" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:46 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ac0735-9d8c-4aca-bb83-ea82e5ac59b6]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:46 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c Nov 03 17:12:46 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:47 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c" returned: 0 in 0.627s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:47 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c Nov 03 17:12:47 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:47 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e403d8c-027e-4994-a359-0b94844d0e3c" returned: 0 in 0.347s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "cinder-quobyte-2e403d8c-027e-4994-a359-0b94844d0e3c" released by "delete_volume" :: held 1.074s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:47 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Created reservations ['87678be8-727e-433b-a0d0-d8e59aa5fd2a', 'fbf53ef3-617a-42d9-8925-efe657783395', '74da68a1-e186-4b60-a1f3-c9eaa7b12f4c', '6e85964f-d208-4c1a-8c3c-4dc7b1f9d75b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:48 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:12:48 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:48 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.492s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:48 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Deleted volume successfully. Nov 03 17:12:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-55b3e9aa-a680-4b34-a892-f01315011751 tempest-TestServerVolumeAttachScenarioOldVersion-604309170 None] Lock "cinder-2e403d8c-027e-4994-a359-0b94844d0e3c-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Acquiring lock "cinder-162c269d-089c-40b0-93ad-8725a8211a05-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Lock "cinder-162c269d-089c-40b0-93ad-8725a8211a05-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Acquiring lock "cinder-quobyte-162c269d-089c-40b0-93ad-8725a8211a05" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:12:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Lock "cinder-quobyte-162c269d-089c-40b0-93ad-8725a8211a05" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:12:52 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9cadef-7dcf-42b7-9851-16aab3a2ba9e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:12:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:52 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05 Nov 03 17:12:52 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:53 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05" returned: 0 in 0.763s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:53 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05 Nov 03 17:12:53 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:53 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-162c269d-089c-40b0-93ad-8725a8211a05" returned: 0 in 0.442s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Lock "cinder-quobyte-162c269d-089c-40b0-93ad-8725a8211a05" released by "delete_volume" :: held 1.293s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:12:53 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Created reservations ['545fbb00-153b-44ef-8904-39ea54660cc5', 'f6082aab-8955-4ee9-b2ff-b1a2ac30a113', 'a87532b2-206b-45ed-955c-e51e19e5bac0', 'f94d8076-28fa-4915-90ec-26b35b6787bb'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:12:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:12:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:12:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:12:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:12:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:12:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:12:53 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:12:53 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:12:54 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Nov 03 17:12:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.328s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:12:54 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:12:54 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Deleted volume successfully. Nov 03 17:12:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7be84596-00aa-457f-ace5-83bb5db93370 tempest-VolumesNegativeTest-253584638 None] Lock "cinder-162c269d-089c-40b0-93ad-8725a8211a05-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Flow 'volume_create_manager' (99c4c355-3430-41e3-9439-474f270d4f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb718492-e288-40a2-8794-99e0d681606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb718492-e288-40a2-8794-99e0d681606e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1118464474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d59656-9d21-47ec-afa8-ae91b0ac10fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e8faaa98b945f3ad987879d4725d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:10Z,use_quota=True,user_id='b2f0d18a4c384ed0820b3a414e2b92ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f5037dc-9658-4583-8e28-0391496bd435),volume_type_id=4f5037dc-9658-4583-8e28-0391496bd435)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08ff591-4b36-41ac-8d21-957df34e8597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08ff591-4b36-41ac-8d21-957df34e8597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c381e93f-5890-4e8f-a664-84f285922131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c381e93f-5890-4e8f-a664-84f285922131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6d59656-9d21-47ec-afa8-ae91b0ac10fb', 'volume_name': 'volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bfdc8f-5fd0-491e-a0ca-7556316735f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bfdc8f-5fd0-491e-a0ca-7556316735f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0b3cca-f6f1-48d9-9562-4479bc6398b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:10 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Volume d6d59656-9d21-47ec-afa8-ae91b0ac10fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb', 'volume_size': 1} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1118464474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d59656-9d21-47ec-afa8-ae91b0ac10fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e8faaa98b945f3ad987879d4725d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:10Z,use_quota=True,user_id='b2f0d18a4c384ed0820b3a414e2b92ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f5037dc-9658-4583-8e28-0391496bd435),volume_type_id=4f5037dc-9658-4583-8e28-0391496bd435)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Creating volume d6d59656-9d21-47ec-afa8-ae91b0ac10fb {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:10 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:13:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:10 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb 1073741824 Nov 03 17:13:10 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Flow 'volume_create_manager' (ff613301-1ac1-4de1-b372-74ba72a6b14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd64ddb-0753-43a1-beb1-eb1b4147fc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd64ddb-0753-43a1-beb1-eb1b4147fc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-52247396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa83fea1-08ca-4b89-b055-a9bdaf235a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e8faaa98b945f3ad987879d4725d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:11Z,use_quota=True,user_id='b2f0d18a4c384ed0820b3a414e2b92ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eb5c0f8-0d18-41e5-bbe1-638dcc8be069),volume_type_id=9eb5c0f8-0d18-41e5-bbe1-638dcc8be069)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea06e27d-18be-48f9-ae86-93b3e693e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea06e27d-18be-48f9-ae86-93b3e693e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55dfe748-ccbd-4886-ad79-3cb5c5aa4626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55dfe748-ccbd-4886-ad79-3cb5c5aa4626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa83fea1-08ca-4b89-b055-a9bdaf235a4e', 'volume_name': 'volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad00108-fc79-44da-804a-a214954ad2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad00108-fc79-44da-804a-a214954ad2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949bea4c-8da2-4468-9149-e564895f92e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:11 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Volume fa83fea1-08ca-4b89-b055-a9bdaf235a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e', 'volume_size': 1} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:11 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb 1073741824" returned: 0 in 0.892s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:11 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb Nov 03 17:13:11 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:11 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb" returned: 0 in 0.353s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.507s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-52247396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa83fea1-08ca-4b89-b055-a9bdaf235a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e8faaa98b945f3ad987879d4725d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:11Z,use_quota=True,user_id='b2f0d18a4c384ed0820b3a414e2b92ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eb5c0f8-0d18-41e5-bbe1-638dcc8be069),volume_type_id=9eb5c0f8-0d18-41e5-bbe1-638dcc8be069)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Creating volume fa83fea1-08ca-4b89-b055-a9bdaf235a4e {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:11 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0b3cca-f6f1-48d9-9562-4479bc6398b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:11 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e 1073741824 Nov 03 17:13:11 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8250fa4-67a7-4b79-955b-2713d096d0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:11 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Volume volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb (d6d59656-9d21-47ec-afa8-ae91b0ac10fb): created successfully Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8250fa4-67a7-4b79-955b-2713d096d0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Flow 'volume_create_manager' (99c4c355-3430-41e3-9439-474f270d4f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:12 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-96097727-b216-4bcd-9367-c0be2661e154 tempest-TestInstancesWithCinderVolumes-1014524844 None] Created volume successfully. Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Flow 'volume_create_manager' (69c4fa9a-ec20-4b3e-aa47-bd1ba790ea0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1deca3-f7a7-4daf-8113-671cf3c60a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1deca3-f7a7-4daf-8113-671cf3c60a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1609456911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94e3db0-0e77-47dd-9e99-e7d065ada95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e8faaa98b945f3ad987879d4725d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:12Z,use_quota=True,user_id='b2f0d18a4c384ed0820b3a414e2b92ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b495acd2-da2f-49cb-9598-8c19925ba5d6),volume_type_id=b495acd2-da2f-49cb-9598-8c19925ba5d6)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff169bee-cb68-48fe-9453-953bdd6a0331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff169bee-cb68-48fe-9453-953bdd6a0331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c942f23-669e-4496-a84e-b5ea200f9825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.image.glance [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Creating Keystone auth plugin from conf {{(pid=86661) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:13:12 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e 1073741824" returned: 0 in 0.644s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:12 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e Nov 03 17:13:12 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c942f23-669e-4496-a84e-b5ea200f9825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a94e3db0-0e77-47dd-9e99-e7d065ada95c', 'volume_name': 'volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c', 'volume_size': 1, 'image_id': 'a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--570241658', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63e8faaa98b945f3ad987879d4725d0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a8a7b76e-83c1-4dc1-b256-d3e07ea7df31/file', 'properties': {}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da214b1-72ca-454d-ae2b-8031c4cc2591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da214b1-72ca-454d-ae2b-8031c4cc2591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c844ad47-ce07-45ec-8dd2-cf3c96d34bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:12 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Volume a94e3db0-0e77-47dd-9e99-e7d065ada95c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c', 'volume_size': 1, 'image_id': 'a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--570241658', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63e8faaa98b945f3ad987879d4725d0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a8a7b76e-83c1-4dc1-b256-d3e07ea7df31/file', 'properties': {}}, 'image_service': } Nov 03 17:13:12 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Trying to clone a94e3db0-0e77-47dd-9e99-e7d065ada95c from image a8a7b76e-83c1-4dc1-b256-d3e07ea7df31 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'metadata': {}}]). {{(pid=86661) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:13:13 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e" returned: 0 in 0.387s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949bea4c-8da2-4468-9149-e564895f92e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080d8692-07b8-4425-8843-66c5e45637d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:13 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Volume volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e (fa83fea1-08ca-4b89-b055-a9bdaf235a4e): created successfully Nov 03 17:13:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080d8692-07b8-4425-8843-66c5e45637d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Flow 'volume_create_manager' (ff613301-1ac1-4de1-b372-74ba72a6b14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:13 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f27e5912-0370-4c79-8d65-cf9a9fcdb879 tempest-TestInstancesWithCinderVolumes-1014524844 None] Created volume successfully. Nov 03 17:13:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-89c40a61-8ab4-4438-b4a7-f25e65971b22 req-8df1fe29-32e7-4df9-8c7e-2d84c53ef311 tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-89c40a61-8ab4-4438-b4a7-f25e65971b22 req-8df1fe29-32e7-4df9-8c7e-2d84c53ef311 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-89c40a61-8ab4-4438-b4a7-f25e65971b22 req-8df1fe29-32e7-4df9-8c7e-2d84c53ef311 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-89c40a61-8ab4-4438-b4a7-f25e65971b22 req-8df1fe29-32e7-4df9-8c7e-2d84c53ef311 tempest-TestServerVolumeAttachmentScenario-497544685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8656aacc-8301-4f41-be85-3cbd7e64ec10', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:13:14 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-89c40a61-8ab4-4438-b4a7-f25e65971b22 req-8df1fe29-32e7-4df9-8c7e-2d84c53ef311 tempest-TestServerVolumeAttachmentScenario-497544685 None] attachment_update completed successfully. Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Flow 'volume_create_manager' (761178de-60ce-4730-a853-a4a15519a5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501fe88f-8c9e-46ae-9e1e-8a3d5e9872f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501fe88f-8c9e-46ae-9e1e-8a3d5e9872f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1624429831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c714c1d4-9198-4ddb-b5dc-8326b71e4aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b00df56ce2841ac9cd49b23b336b334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:16Z,use_quota=True,user_id='26df6db53c33422a871e227c1c460c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732975e0-df92-41b8-9b26-ee26a0e76f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732975e0-df92-41b8-9b26-ee26a0e76f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736aac9b-41ad-4308-9afc-c50b6b8381ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736aac9b-41ad-4308-9afc-c50b6b8381ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c714c1d4-9198-4ddb-b5dc-8326b71e4aeb', 'volume_name': 'volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1c4942-717a-4e5d-b340-7d110f9495d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1c4942-717a-4e5d-b340-7d110f9495d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e325dbd9-ca24-4a7a-8c74-c373f7786dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:16 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Volume c714c1d4-9198-4ddb-b5dc-8326b71e4aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb', 'volume_size': 1} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1624429831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c714c1d4-9198-4ddb-b5dc-8326b71e4aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b00df56ce2841ac9cd49b23b336b334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:16Z,use_quota=True,user_id='26df6db53c33422a871e227c1c460c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Creating volume c714c1d4-9198-4ddb-b5dc-8326b71e4aeb {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:16 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:13:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:16 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb 1073741824 Nov 03 17:13:16 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:17 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb 1073741824" returned: 0 in 0.614s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:17 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb Nov 03 17:13:17 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:17 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb" returned: 0 in 0.420s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e325dbd9-ca24-4a7a-8c74-c373f7786dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ad5aa2-b96d-4470-9e8e-dc9f9a75bcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:17 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Volume volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb (c714c1d4-9198-4ddb-b5dc-8326b71e4aeb): created successfully Nov 03 17:13:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ad5aa2-b96d-4470-9e8e-dc9f9a75bcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Flow 'volume_create_manager' (761178de-60ce-4730-a853-a4a15519a5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:17 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-786ecf4e-e7cc-421a-bfa3-21d20c2d2378 tempest-VolumesSnapshotTestJSON-598074943 None] Created volume successfully. Nov 03 17:13:18 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD, size 20.69 MB, duration 5.05 sec {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:13:18 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Image download 20.69 MB at 4.09 MB/s Nov 03 17:13:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5faca6d-3519-4d6c-afc3-b0f865d112a5]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:18 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD Nov 03 17:13:18 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:18 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:18 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Temporary image a8a7b76e-83c1-4dc1-b256-d3e07ea7df31 is fetched for user b2f0d18a4c384ed0820b3a414e2b92ac. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:13:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[74121fdc-cf97-425c-9844-cd4fda1b8d49]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:18 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD Nov 03 17:13:18 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:19 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1609456911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94e3db0-0e77-47dd-9e99-e7d065ada95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e8faaa98b945f3ad987879d4725d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:12Z,use_quota=True,user_id='b2f0d18a4c384ed0820b3a414e2b92ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b495acd2-da2f-49cb-9598-8c19925ba5d6),volume_type_id=b495acd2-da2f-49cb-9598-8c19925ba5d6)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Creating volume a94e3db0-0e77-47dd-9e99-e7d065ada95c {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:19 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:19 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c 1073741824 Nov 03 17:13:19 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:19 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c 1073741824" returned: 0 in 0.651s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:19 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c Nov 03 17:13:19 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:20 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c" returned: 0 in 0.353s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.043s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] Creating offline snapshot d7fef89c-339a-4e6b-b810-dbdf32def72b of volume c714c1d4-9198-4ddb-b5dc-8326b71e4aeb {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Attempting download of a8a7b76e-83c1-4dc1-b256-d3e07ea7df31 ((None, [{'url': 'file:///opt/stack/data/glance/images/a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'metadata': {}}])) to volume a94e3db0-0e77-47dd-9e99-e7d065ada95c. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd60193-db42-457c-b326-adbaf1686540]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[840dacac-26fd-46cf-b06c-bb20733a7f0b]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_s4ai0bim {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-782690aa-d395-4dfc-a378-bd327704c302 req-fd09476d-bff6-4e73-9f4a-200260c1f926 tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:20 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb Nov 03 17:13:20 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:20 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_s4ai0bim Nov 03 17:13:20 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:20 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb" returned: 0 in 0.446s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:20 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b 1G Nov 03 17:13:20 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:20 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_s4ai0bim" returned: 0 in 0.403s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_s4ai0bim {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:20 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_s4ai0bim Nov 03 17:13:20 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:21 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_s4ai0bim" returned: 1 in 0.438s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_s4ai0bim' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e297ba4-8266-47b6-9bc0-20797a2b750e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:21 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b 1G" returned: 0 in 0.558s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:21 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b Nov 03 17:13:21 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:21 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD Nov 03 17:13:21 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:21 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] a8a7b76e-83c1-4dc1-b256-d3e07ea7df31 was qcow2, converting to qcow2 {{(pid=86661) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:21 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c Nov 03 17:13:21 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:21 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b" returned: 0 in 0.351s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b is being set with open permissions: ugo+rw Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:21 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b Nov 03 17:13:21 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:21 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b" returned: 0 in 0.276s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:21 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.info Nov 03 17:13:21 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:22 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.info" returned: 0 in 0.303s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:22 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.info is being set with open permissions: ugo+rw Nov 03 17:13:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:22 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.info Nov 03 17:13:22 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:22 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.info" returned: 0 in 0.257s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-782690aa-d395-4dfc-a378-bd327704c302 req-fd09476d-bff6-4e73-9f4a-200260c1f926 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.209s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-782690aa-d395-4dfc-a378-bd327704c302 req-fd09476d-bff6-4e73-9f4a-200260c1f926 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-782690aa-d395-4dfc-a378-bd327704c302 req-fd09476d-bff6-4e73-9f4a-200260c1f926 tempest-TestServerVolumeAttachmentScenario-497544685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-7157f306-b8df-42cb-8227-3781be9ce949', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01111cb3-bd2c-4ca5-9647-6a367d526171', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:13:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e9ca1190-553e-432b-bccf-5ee9ce91509b tempest-VolumesSnapshotTestJSON-598074943 None] Create snapshot completed successfully Nov 03 17:13:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-782690aa-d395-4dfc-a378-bd327704c302 req-fd09476d-bff6-4e73-9f4a-200260c1f926 tempest-TestServerVolumeAttachmentScenario-497544685 None] attachment_update completed successfully. Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-d7fef89c-339a-4e6b-b810-dbdf32def72b-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-d7fef89c-339a-4e6b-b810-dbdf32def72b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-d7fef89c-339a-4e6b-b810-dbdf32def72b" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-d7fef89c-339a-4e6b-b810-dbdf32def72b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Deleting offline snapshot d7fef89c-339a-4e6b-b810-dbdf32def72b of volume c714c1d4-9198-4ddb-b5dc-8326b71e4aeb {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] snapshot_file for this snap is: volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b053a6-ddb0-4d2b-92ba-27d36545b98d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:23 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b Nov 03 17:13:23 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:23 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c" returned: 0 in 2.378s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a8a7b76e-83c1-4dc1-b256-d3e07ea7df31_glapfrzpdevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:13:23 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Converted 112.00 MB image at 47.08 MB/s Nov 03 17:13:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:23 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c 1G Nov 03 17:13:23 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:24 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b" returned: 0 in 0.428s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14c5dd5-a3cb-4e3a-be4f-22bac2708fb4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:24 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb Nov 03 17:13:24 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:24 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c 1G" returned: 0 in 0.382s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Downloaded image a8a7b76e-83c1-4dc1-b256-d3e07ea7df31 ((None, [{'url': 'file:///opt/stack/data/glance/images/a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'metadata': {}}])) to volume a94e3db0-0e77-47dd-9e99-e7d065ada95c successfully. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Temporary image a8a7b76e-83c1-4dc1-b256-d3e07ea7df31 for user b2f0d18a4c384ed0820b3a414e2b92ac is deleted. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Marking volume a94e3db0-0e77-47dd-9e99-e7d065ada95c as bootable. {{(pid=86661) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Copying metadata from image a8a7b76e-83c1-4dc1-b256-d3e07ea7df31 to a94e3db0-0e77-47dd-9e99-e7d065ada95c. {{(pid=86661) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Creating volume glance metadata for volume a94e3db0-0e77-47dd-9e99-e7d065ada95c backed by image a8a7b76e-83c1-4dc1-b256-d3e07ea7df31 with: {'image_id': 'a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'image_name': 'tempest-scenario-img--570241658', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86661) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c844ad47-ce07-45ec-8dd2-cf3c96d34bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c', 'volume_size': 1, 'image_id': 'a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--570241658', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63e8faaa98b945f3ad987879d4725d0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a8a7b76e-83c1-4dc1-b256-d3e07ea7df31', 'created_at': datetime.datetime(2026, 11, 3, 16, 13, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 13, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a8a7b76e-83c1-4dc1-b256-d3e07ea7df31/file', 'properties': {}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc200e2a-adc4-48e9-8600-3306a06b2bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:24 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Volume volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c (a94e3db0-0e77-47dd-9e99-e7d065ada95c): created successfully Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc200e2a-adc4-48e9-8600-3306a06b2bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Flow 'volume_create_manager' (69c4fa9a-ec20-4b3e-aa47-bd1ba790ea0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-9b604f42-c27c-46f9-988b-5c057e37589a tempest-TestInstancesWithCinderVolumes-1014524844 None] Created volume successfully. Nov 03 17:13:24 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb" returned: 0 in 0.488s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:24 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b Nov 03 17:13:24 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:25 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b" returned: 0 in 0.445s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:25 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b Nov 03 17:13:25 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:25 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb.d7fef89c-339a-4e6b-b810-dbdf32def72b" returned: 0 in 0.358s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-d7fef89c-339a-4e6b-b810-dbdf32def72b" released by "_delete_snapshot" :: held 1.888s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-a785bc6f-6934-4986-bd4c-6f11e8dfc19e req-2e2977a6-a33c-4764-ad8d-cbe26608f181 tempest-TestServerVolumeAttachmentScenario-497544685 None] Terminate volume connection completed successfully. Nov 03 17:13:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-a785bc6f-6934-4986-bd4c-6f11e8dfc19e req-2e2977a6-a33c-4764-ad8d-cbe26608f181 tempest-TestServerVolumeAttachmentScenario-497544685 None] Deleting attachment 01111cb3-bd2c-4ca5-9647-6a367d526171. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:13:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb" released by "delete_snapshot" :: held 1.920s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:25 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Created reservations ['6c8512ac-27fd-4e9b-bfeb-3ee893002cc1', '14910ce5-cf97-4d8b-aeed-0a7c07c7ac8c', 'af97fe3c-0ca8-4f66-8ff1-e0218f5268a5', 'e1b735b5-f546-46c1-9fde-219e95be6a6a'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Delete snapshot completed successfully. Nov 03 17:13:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-be596cdf-4c60-439b-acff-08263257bfdf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-d7fef89c-339a-4e6b-b810-dbdf32def72b-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-aa05e218-885d-43f7-8206-dde14ee8135d req-0aa01084-86cb-4330-bbe8-b6954150f809 tempest-TestServerVolumeAttachmentScenario-497544685 None] Terminate volume connection completed successfully. Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-aa05e218-885d-43f7-8206-dde14ee8135d req-0aa01084-86cb-4330-bbe8-b6954150f809 tempest-TestServerVolumeAttachmentScenario-497544685 None] Deleting attachment 8656aacc-8301-4f41-be85-3cbd7e64ec10. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Flow 'volume_create_manager' (addfcabe-4b44-4dd0-95d4-f990cf1359e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07364f58-6ea1-4c02-9d7e-cecc78ee351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07364f58-6ea1-4c02-9d7e-cecc78ee351e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-146230167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf32e2f4-3640-4c41-947a-7a62c8ff40d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b00df56ce2841ac9cd49b23b336b334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:28Z,use_quota=True,user_id='26df6db53c33422a871e227c1c460c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235cd158-e556-4dbd-bb5f-575da9097a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235cd158-e556-4dbd-bb5f-575da9097a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6bf01c-4efb-4937-b26a-f0233b465405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6bf01c-4efb-4937-b26a-f0233b465405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf32e2f4-3640-4c41-947a-7a62c8ff40d1', 'volume_name': 'volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea9963f-bd4c-45e4-b3fb-80ba516f8253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea9963f-bd4c-45e4-b3fb-80ba516f8253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a2f2f9-74b7-40fe-ae62-9480a634c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:27 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Volume bf32e2f4-3640-4c41-947a-7a62c8ff40d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1', 'volume_size': 1} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-146230167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf32e2f4-3640-4c41-947a-7a62c8ff40d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b00df56ce2841ac9cd49b23b336b334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:28Z,use_quota=True,user_id='26df6db53c33422a871e227c1c460c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Creating volume bf32e2f4-3640-4c41-947a-7a62c8ff40d1 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:27 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:13:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:27 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 1073741824 Nov 03 17:13:27 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:28 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 1073741824" returned: 0 in 0.847s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:28 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 Nov 03 17:13:28 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-2925b9fb-048e-4620-acb2-464b510620a3 req-9b24ee1b-541d-4ebb-8983-139939cce332 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:29 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" returned: 0 in 0.382s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-2925b9fb-048e-4620-acb2-464b510620a3 req-9b24ee1b-541d-4ebb-8983-139939cce332 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.167s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a2f2f9-74b7-40fe-ae62-9480a634c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a467025-5edd-468f-83ce-2bbbe17ecfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-2925b9fb-048e-4620-acb2-464b510620a3 req-9b24ee1b-541d-4ebb-8983-139939cce332 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:29 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Volume volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 (bf32e2f4-3640-4c41-947a-7a62c8ff40d1): created successfully Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a467025-5edd-468f-83ce-2bbbe17ecfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Flow 'volume_create_manager' (addfcabe-4b44-4dd0-95d4-f990cf1359e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:29 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-209dd013-108f-4124-b14e-6edf586ea28d tempest-VolumesSnapshotTestJSON-598074943 None] Created volume successfully. Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-2925b9fb-048e-4620-acb2-464b510620a3 req-9b24ee1b-541d-4ebb-8983-139939cce332 tempest-TestInstancesWithCinderVolumes-1014524844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5cfe0fd-03dd-4f42-866f-2541adf3a856', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:13:29 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-2925b9fb-048e-4620-acb2-464b510620a3 req-9b24ee1b-541d-4ebb-8983-139939cce332 tempest-TestInstancesWithCinderVolumes-1014524844 None] attachment_update completed successfully. Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:29 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:13:29 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] Creating offline snapshot 3cf44325-152d-4549-ab8e-6eaa458b9a66 of volume bf32e2f4-3640-4c41-947a-7a62c8ff40d1 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab2be6c-a80f-45bb-8f07-1af607cea65c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:30 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.424s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:13:30 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 Nov 03 17:13:30 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:30 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" returned: 0 in 0.405s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:30 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 1G Nov 03 17:13:30 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:31 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 1G" returned: 0 in 0.518s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:31 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 Nov 03 17:13:31 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:31 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66" returned: 0 in 0.423s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:31 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 is being set with open permissions: ugo+rw Nov 03 17:13:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:31 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 Nov 03 17:13:31 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:31 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66" returned: 0 in 0.319s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:31 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.info Nov 03 17:13:31 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:32 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.info" returned: 0 in 0.329s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:32 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.info is being set with open permissions: ugo+rw Nov 03 17:13:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:32 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.info Nov 03 17:13:32 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:32 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.info" returned: 0 in 0.281s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:32 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-65e300bb-7049-42a5-9e04-f53ad2780212 tempest-VolumesSnapshotTestJSON-598074943 None] Create snapshot completed successfully Nov 03 17:13:33 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Flow 'volume_create_manager' (f7a347ad-c229-4913-82ed-1d1d44514788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544f286c-b7f3-4c14-9bfe-bf341cf12b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544f286c-b7f3-4c14-9bfe-bf341cf12b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1818119204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9167c6c-61cd-44b0-9a3c-19ed638d730c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b00df56ce2841ac9cd49b23b336b334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3cf44325-152d-4549-ab8e-6eaa458b9a66,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:34Z,use_quota=True,user_id='26df6db53c33422a871e227c1c460c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b6d440-edc5-4f0e-b43b-27d67f7e9d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b6d440-edc5-4f0e-b43b-27d67f7e9d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f192f6-9c4e-471a-89f5-d1736ecb9417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f192f6-9c4e-471a-89f5-d1736ecb9417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9167c6c-61cd-44b0-9a3c-19ed638d730c', 'volume_name': 'volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c', 'volume_size': 2, 'snapshot_id': '3cf44325-152d-4549-ab8e-6eaa458b9a66'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9ae9a6-b957-4743-8886-13cb69a4ad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9ae9a6-b957-4743-8886-13cb69a4ad94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6b3454-29c3-4ea8-8270-091f0401716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:34 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Volume e9167c6c-61cd-44b0-9a3c-19ed638d730c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c', 'volume_size': 2, 'snapshot_id': '3cf44325-152d-4549-ab8e-6eaa458b9a66'} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-3cf44325-152d-4549-ab8e-6eaa458b9a66-e9167c6c-61cd-44b0-9a3c-19ed638d730c" by "_create_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-3cf44325-152d-4549-ab8e-6eaa458b9a66-e9167c6c-61cd-44b0-9a3c-19ed638d730c" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Creating volume e9167c6c-61cd-44b0-9a3c-19ed638d730c from snapshot 3cf44325-152d-4549-ab8e-6eaa458b9a66 {{(pid=86661) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-e9167c6c-61cd-44b0-9a3c-19ed638d730c" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-e9167c6c-61cd-44b0-9a3c-19ed638d730c" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] snapshot: 3cf44325-152d-4549-ab8e-6eaa458b9a66, volume: e9167c6c-61cd-44b0-9a3c-19ed638d730c, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a516e6-cbc6-4016-b272-8f4bc399dcdf]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:34 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 Nov 03 17:13:34 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:34 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66" returned: 0 in 0.438s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[001f24a8-eb59-410e-9ed9-782348226cd8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:34 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 Nov 03 17:13:34 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:35 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" returned: 0 in 0.485s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:13:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:13:35 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:13:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:35 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c Nov 03 17:13:35 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "cinder-7157f306-b8df-42cb-8227-3781be9ce949-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "cinder-7157f306-b8df-42cb-8227-3781be9ce949-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:41 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=73,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:13:41 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=77,cinder:UPDATE=51,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:13:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "cinder-quobyte-7157f306-b8df-42cb-8227-3781be9ce949" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "cinder-quobyte-7157f306-b8df-42cb-8227-3781be9ce949" acquired by "delete_volume" :: waited 0.060s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:41 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[d055de19-40d3-48a8-8320-ee1f7c4f51a8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:41 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949 Nov 03 17:13:41 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:42 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949" returned: 0 in 0.767s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:42 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949 Nov 03 17:13:42 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:42 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7157f306-b8df-42cb-8227-3781be9ce949" returned: 0 in 0.564s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "cinder-quobyte-7157f306-b8df-42cb-8227-3781be9ce949" released by "delete_volume" :: held 1.487s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Created reservations ['32a62ab8-b5c1-41fc-ad0c-dfc745e6cdd1', '7a1243da-6be6-449f-8df1-f65bc536a28a', 'ca87e468-d5fc-4a8b-910c-e8c3b05f2cff', '4a85f8c7-395b-4985-8b35-546a8f6ca01a'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:43 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:13:43 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "cinder-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "cinder-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:43 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.642s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "cinder-quobyte-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:43 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Deleted volume successfully. Nov 03 17:13:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "cinder-quobyte-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02" acquired by "delete_volume" :: waited 0.105s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e9b38891-7ad4-49f7-a149-714cc019ef7e tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "cinder-7157f306-b8df-42cb-8227-3781be9ce949-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:44 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c221e7-db25-458a-b6e0-a033ae8c88fc]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:44 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02 Nov 03 17:13:44 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:45 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02" returned: 0 in 1.428s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:45 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02 Nov 03 17:13:45 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:46 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02" returned: 0 in 1.115s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "cinder-quobyte-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02" released by "delete_volume" :: held 2.696s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:46 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Created reservations ['a285d185-201d-451b-b84c-661d0054e73f', '0b33e74b-d680-4349-8ee0-094803b5034f', '0ffa42e1-4ac3-47e8-a27d-15ee38c417bd', '91ccd66f-8957-44da-816a-bf3fdba94779'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:47 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:13:47 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:47 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c" returned: 0 in 12.578s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:47 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1, size 1024.00 MB, duration 12.58 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:13:47 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Converted 1024.00 MB image at 81.38 MB/s Nov 03 17:13:47 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c is being set with open permissions: ugo+rw Nov 03 17:13:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:47 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c Nov 03 17:13:47 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:47 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.732s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:47 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:47 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Deleted volume successfully. Nov 03 17:13:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d6413f1f-e717-4ae2-8f40-fb904f1e8751 tempest-TestServerVolumeAttachmentScenario-497544685 None] Lock "cinder-0d28c5e4-7496-4a92-9b52-6d9f3cac5b02-delete_volume" released by "delete_volume" :: held 4.224s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:48 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c" returned: 0 in 0.422s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-e9167c6c-61cd-44b0-9a3c-19ed638d730c" released by "_copy_volume_from_snapshot" :: held 14.074s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-3cf44325-152d-4549-ab8e-6eaa458b9a66-e9167c6c-61cd-44b0-9a3c-19ed638d730c" released by "_create_volume_from_snapshot" :: held 14.187s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.218s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6b3454-29c3-4ea8-8270-091f0401716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c', 'volume_size': 2, 'snapshot_id': '3cf44325-152d-4549-ab8e-6eaa458b9a66'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba07b20-7189-4756-8daf-8790e53c457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:48 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Volume volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c (e9167c6c-61cd-44b0-9a3c-19ed638d730c): created successfully Nov 03 17:13:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba07b20-7189-4756-8daf-8790e53c457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Flow 'volume_create_manager' (f7a347ad-c229-4913-82ed-1d1d44514788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-573c53d5-b1be-43e2-8def-f838a94b3071 tempest-VolumesSnapshotTestJSON-598074943 None] Created volume successfully. Nov 03 17:13:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-e9167c6c-61cd-44b0-9a3c-19ed638d730c-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-e9167c6c-61cd-44b0-9a3c-19ed638d730c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-e9167c6c-61cd-44b0-9a3c-19ed638d730c" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-e9167c6c-61cd-44b0-9a3c-19ed638d730c" acquired by "delete_volume" :: waited 0.034s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:49 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[607a5a78-f014-4931-9423-89af5fa809ec]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:49 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c Nov 03 17:13:49 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:50 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c" returned: 0 in 0.517s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:50 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c Nov 03 17:13:50 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:50 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e9167c6c-61cd-44b0-9a3c-19ed638d730c" returned: 0 in 0.301s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-e9167c6c-61cd-44b0-9a3c-19ed638d730c" released by "delete_volume" :: held 0.891s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:50 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Created reservations ['041cb428-b77f-40ba-aaa2-69b8f7f63b9b', '640f78db-837d-4b53-b5e5-3a7934a1a23b', 'cb8ad592-8827-440a-940b-fbc0007fab2f', '7f55873f-9c8e-4389-974c-cdf44e049481'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:50 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:13:50 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:51 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.379s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:51 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Deleted volume successfully. Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5c9332b9-3ea9-4573-a672-99d916cceebf tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-e9167c6c-61cd-44b0-9a3c-19ed638d730c-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-3cf44325-152d-4549-ab8e-6eaa458b9a66-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-3cf44325-152d-4549-ab8e-6eaa458b9a66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-3cf44325-152d-4549-ab8e-6eaa458b9a66" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-3cf44325-152d-4549-ab8e-6eaa458b9a66" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Deleting offline snapshot 3cf44325-152d-4549-ab8e-6eaa458b9a66 of volume bf32e2f4-3640-4c41-947a-7a62c8ff40d1 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] snapshot_file for this snap is: volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[29186425-bd0c-4c00-873c-bd20972830ca]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:52 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 Nov 03 17:13:52 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:52 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66" returned: 0 in 0.470s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:13:52 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1966d1-bbb0-41a6-aa9f-81822905ceb7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:52 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 Nov 03 17:13:52 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:53 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" returned: 0 in 0.878s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:53 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 Nov 03 17:13:53 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:53 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66" returned: 0 in 0.450s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:53 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66 Nov 03 17:13:53 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:54 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1.3cf44325-152d-4549-ab8e-6eaa458b9a66" returned: 0 in 0.347s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-3cf44325-152d-4549-ab8e-6eaa458b9a66" released by "_delete_snapshot" :: held 2.349s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" released by "delete_snapshot" :: held 2.381s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:54 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Created reservations ['9cc962cc-36bb-45bc-b9d5-94545344a2e0', '17e2945e-617c-4d82-bad6-28780562adc9', '1397e3de-240f-4991-be6b-dadaef9e2d32', 'f216bf6e-190f-462a-9016-be2aa1accd92'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:54 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Delete snapshot completed successfully. Nov 03 17:13:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5f613299-ab05-4b49-bbff-d6e94f914755 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-3cf44325-152d-4549-ab8e-6eaa458b9a66-delete_snapshot" released by "delete_snapshot" :: held 2.701s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-bf32e2f4-3640-4c41-947a-7a62c8ff40d1-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-bf32e2f4-3640-4c41-947a-7a62c8ff40d1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:13:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" acquired by "delete_volume" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:13:55 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3befc75-bc18-4442-a29c-5e3f14ed41f0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:13:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:55 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 Nov 03 17:13:55 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:56 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" returned: 0 in 0.673s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:56 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1 Nov 03 17:13:56 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:56 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" returned: 0 in 0.346s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-bf32e2f4-3640-4c41-947a-7a62c8ff40d1" released by "delete_volume" :: held 1.111s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:56 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Created reservations ['68a93aea-57f6-42df-92d3-b1e80456d609', '105fd882-a0e7-4675-8706-bc91e699947f', '50220bed-2276-4204-b064-f4b27f16e224', 'd79160d9-e2a3-40f1-b14a-94637c179bfc'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:13:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:56 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:13:56 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:57 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.309s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:57 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:13:57 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Deleted volume successfully. Nov 03 17:13:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-685e4d0b-1f14-4fdf-bb24-c3c48e47e09e tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-bf32e2f4-3640-4c41-947a-7a62c8ff40d1-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Flow 'volume_create_manager' (05de0044-3bb2-40b4-91d7-c9afa1d4d9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17509a9-1f11-412a-9fd1-411b17144073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17509a9-1f11-412a-9fd1-411b17144073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1348816095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf81b133-7a60-4832-9f6d-d31e54d79afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b00df56ce2841ac9cd49b23b336b334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:58Z,use_quota=True,user_id='26df6db53c33422a871e227c1c460c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff729c99-c202-4d87-870c-19235fd17c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff729c99-c202-4d87-870c-19235fd17c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772e074e-2508-4425-9d67-a08e411b3cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772e074e-2508-4425-9d67-a08e411b3cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf81b133-7a60-4832-9f6d-d31e54d79afb', 'volume_name': 'volume-cf81b133-7a60-4832-9f6d-d31e54d79afb', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af838ca4-41a7-4cbb-9759-ad494e30206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af838ca4-41a7-4cbb-9759-ad494e30206c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e845a0-205b-47fd-84d7-51dc02b0e05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:13:58 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Volume cf81b133-7a60-4832-9f6d-d31e54d79afb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf81b133-7a60-4832-9f6d-d31e54d79afb', 'volume_size': 1} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1348816095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf81b133-7a60-4832-9f6d-d31e54d79afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b00df56ce2841ac9cd49b23b336b334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:13:58Z,use_quota=True,user_id='26df6db53c33422a871e227c1c460c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Creating volume cf81b133-7a60-4832-9f6d-d31e54d79afb {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:13:58 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:13:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:58 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb 1073741824 Nov 03 17:13:58 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:13:59 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Nov 03 17:13:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb 1073741824" returned: 0 in 0.847s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:13:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:13:59 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb Nov 03 17:13:59 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:00 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb" returned: 0 in 0.435s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e845a0-205b-47fd-84d7-51dc02b0e05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf81b133-7a60-4832-9f6d-d31e54d79afb', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14bcd5a-b57e-40cf-8979-c7f07732bb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:00 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Volume volume-cf81b133-7a60-4832-9f6d-d31e54d79afb (cf81b133-7a60-4832-9f6d-d31e54d79afb): created successfully Nov 03 17:14:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14bcd5a-b57e-40cf-8979-c7f07732bb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Flow 'volume_create_manager' (05de0044-3bb2-40b4-91d7-c9afa1d4d9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:00 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ae3b8e18-1cea-47f1-942b-41b68afe3d4d tempest-VolumesSnapshotTestJSON-598074943 None] Created volume successfully. Nov 03 17:14:00 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Flow 'volume_create_manager' (b4d51984-863d-4630-b129-535ecd51b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41c7023-d119-43d6-9718-b1688e247f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41c7023-d119-43d6-9718-b1688e247f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1094816614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe29c33-7973-48ad-9340-a3ca23b576a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f06eca8c724a6b99729fd2bfdb7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:01Z,use_quota=True,user_id='88f9cf1985f24c10a54a8eb4abd19889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ca906b-88fc-4d74-8a25-029d27a24221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ca906b-88fc-4d74-8a25-029d27a24221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358925ef-8e0c-44d9-971e-ab7cc0cf992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358925ef-8e0c-44d9-971e-ab7cc0cf992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbe29c33-7973-48ad-9340-a3ca23b576a8', 'volume_name': 'volume-fbe29c33-7973-48ad-9340-a3ca23b576a8', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6f0e91-e7dd-4460-9298-5a81839b4951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6f0e91-e7dd-4460-9298-5a81839b4951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ef890d-3155-4f8d-a8eb-f26019823be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:01 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Volume fbe29c33-7973-48ad-9340-a3ca23b576a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbe29c33-7973-48ad-9340-a3ca23b576a8', 'volume_size': 1} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1094816614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe29c33-7973-48ad-9340-a3ca23b576a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f06eca8c724a6b99729fd2bfdb7387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:01Z,use_quota=True,user_id='88f9cf1985f24c10a54a8eb4abd19889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Creating volume fbe29c33-7973-48ad-9340-a3ca23b576a8 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:01 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:01 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 1073741824 Nov 03 17:14:01 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:01 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 1073741824" returned: 0 in 0.576s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:01 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 Nov 03 17:14:01 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:01 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8" returned: 0 in 0.290s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.714s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ef890d-3155-4f8d-a8eb-f26019823be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe29c33-7973-48ad-9340-a3ca23b576a8', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ea2461-3d47-4e9b-be27-2d1aa6aabac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] Creating offline snapshot be6cd551-c5b9-4904-b008-8e50d083ac92 of volume cf81b133-7a60-4832-9f6d-d31e54d79afb {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:02 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Volume volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 (fbe29c33-7973-48ad-9340-a3ca23b576a8): created successfully Nov 03 17:14:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ea2461-3d47-4e9b-be27-2d1aa6aabac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Flow 'volume_create_manager' (b4d51984-863d-4630-b129-535ecd51b152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:02 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a15cf12-4eeb-4c6f-9386-9d354d47ba82]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-520931fa-3d65-47ad-b5ab-ce8d34b29209 tempest-TestImageHashVerification-1147621422 None] Created volume successfully. Nov 03 17:14:02 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb Nov 03 17:14:02 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:02 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb" returned: 0 in 0.597s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:02 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 1G Nov 03 17:14:02 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:03 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 1G" returned: 0 in 0.580s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf81b133-7a60-4832-9f6d-d31e54d79afb -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:03 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf81b133-7a60-4832-9f6d-d31e54d79afb -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 Nov 03 17:14:03 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:03 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf81b133-7a60-4832-9f6d-d31e54d79afb -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92" returned: 0 in 0.341s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:03 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 is being set with open permissions: ugo+rw Nov 03 17:14:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:03 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 Nov 03 17:14:03 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:03 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92" returned: 0 in 0.274s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:03 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.info Nov 03 17:14:03 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:04 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.info" returned: 0 in 0.334s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:04 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.info is being set with open permissions: ugo+rw Nov 03 17:14:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:04 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.info Nov 03 17:14:04 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:04 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.info" returned: 0 in 0.281s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.554s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.419s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:04 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[115e6d44-4ed6-49db-b6c9-a8481cb9b937]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8cd45326-cf54-4d02-be0a-f97ed08cc4dd tempest-VolumesSnapshotTestJSON-598074943 None] Create snapshot completed successfully Nov 03 17:14:04 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 Nov 03 17:14:04 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:04 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8" returned: 0 in 0.415s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:05 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf0750e-ec55-460b-bba0-7b373d180086]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:05 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 Nov 03 17:14:05 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:05 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8" returned: 0 in 0.449s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 /opt/stack/data/cinder/conversion/fbe29c33-7973-48ad-9340-a3ca23b576a8.temp_image.39c074e3-df4c-4b5d-8084-21cb522a6fa01_43z0v0.img {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:05 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 /opt/stack/data/cinder/conversion/fbe29c33-7973-48ad-9340-a3ca23b576a8.temp_image.39c074e3-df4c-4b5d-8084-21cb522a6fa01_43z0v0.img Nov 03 17:14:05 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Flow 'volume_create_manager' (bf48b1c8-e3b6-41c1-960f-4bd48ea49c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883a1298-8160-4ee6-80cf-f4c24444d5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (883a1298-8160-4ee6-80cf-f4c24444d5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-955051938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580626b5-c2b0-41a0-895b-2af287f77435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b00df56ce2841ac9cd49b23b336b334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=be6cd551-c5b9-4904-b008-8e50d083ac92,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:06Z,use_quota=True,user_id='26df6db53c33422a871e227c1c460c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed151802-8a15-4234-9f4e-0cd531b5a342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed151802-8a15-4234-9f4e-0cd531b5a342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ddaddf-154c-4b8f-86b1-2b2ef169b31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ddaddf-154c-4b8f-86b1-2b2ef169b31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '580626b5-c2b0-41a0-895b-2af287f77435', 'volume_name': 'volume-580626b5-c2b0-41a0-895b-2af287f77435', 'volume_size': 1, 'snapshot_id': 'be6cd551-c5b9-4904-b008-8e50d083ac92'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c4ded2-d764-4d75-b65f-5f5fd89e0224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c4ded2-d764-4d75-b65f-5f5fd89e0224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26958a3-96e3-494c-81c4-ec6ff9ec3073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:06 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Volume 580626b5-c2b0-41a0-895b-2af287f77435: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-580626b5-c2b0-41a0-895b-2af287f77435', 'volume_size': 1, 'snapshot_id': 'be6cd551-c5b9-4904-b008-8e50d083ac92'} Nov 03 17:14:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-3c13418f-76db-4883-8edf-d8d7558a93ef req-11f7c66f-0947-419c-8177-8e60973759b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:14 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 /opt/stack/data/cinder/conversion/fbe29c33-7973-48ad-9340-a3ca23b576a8.temp_image.39c074e3-df4c-4b5d-8084-21cb522a6fa01_43z0v0.img" returned: 0 in 8.748s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:14 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[130a5387-a7ed-404b-a0e9-78a724b16b20]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:14 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 Nov 03 17:14:14 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:14 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8" returned: 0 in 0.549s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:14 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8, size 1024.00 MB, duration 8.75 sec, destination /opt/stack/data/cinder/conversion/fbe29c33-7973-48ad-9340-a3ca23b576a8.temp_image.39c074e3-df4c-4b5d-8084-21cb522a6fa01_43z0v0.img {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:14:14 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] Converted 1024.00 MB image at 117.05 MB/s Nov 03 17:14:14 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] 39c074e3-df4c-4b5d-8084-21cb522a6fa0 was raw, no need to convert to raw {{(pid=86661) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (0443b1fd-530d-4090-852f-50c325c355f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbb444d-a701-4d9b-8da3-6f6fc9bba038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbb444d-a701-4d9b-8da3-6f6fc9bba038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2020623596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ad5638-2cb1-421d-8df5-21fa5a519859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:15Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007d9658-7bd0-417b-b4b3-db39509aa91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007d9658-7bd0-417b-b4b3-db39509aa91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a186fa9-7f66-458b-bc8c-9e5e6982ed31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a186fa9-7f66-458b-bc8c-9e5e6982ed31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ad5638-2cb1-421d-8df5-21fa5a519859', 'volume_name': 'volume-48ad5638-2cb1-421d-8df5-21fa5a519859', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d50d29-c7c9-4a54-8173-e34d0d6df8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d50d29-c7c9-4a54-8173-e34d0d6df8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14cd476d-7838-411e-94b5-2baec59f9185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:15 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume 48ad5638-2cb1-421d-8df5-21fa5a519859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ad5638-2cb1-421d-8df5-21fa5a519859', 'volume_size': 1} Nov 03 17:14:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:24 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=36,cinder:INSERT=11,cinder:UPDATE=50,cinder:DELETE=4 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:14:25 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=42,cinder:INSERT=13,cinder:UPDATE=46,cinder:DELETE=4 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:14:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:14:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:29 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:14:29 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:30 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.273s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:14:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:14:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.758s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] Uploaded volume to glance image-id: 39c074e3-df4c-4b5d-8084-21cb522a6fa0. {{(pid=86661) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 26.719s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-be6cd551-c5b9-4904-b008-8e50d083ac92-580626b5-c2b0-41a0-895b-2af287f77435" by "_create_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-be6cd551-c5b9-4904-b008-8e50d083ac92-580626b5-c2b0-41a0-895b-2af287f77435" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Creating volume 580626b5-c2b0-41a0-895b-2af287f77435 from snapshot be6cd551-c5b9-4904-b008-8e50d083ac92 {{(pid=86661) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-580626b5-c2b0-41a0-895b-2af287f77435" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-309b10b9-ff6a-442c-9998-585c2c4cf88a tempest-TestImageHashVerification-1147621422 None] Copy volume to image completed successfully. Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-580626b5-c2b0-41a0-895b-2af287f77435" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] snapshot: be6cd551-c5b9-4904-b008-8e50d083ac92, volume: 580626b5-c2b0-41a0-895b-2af287f77435, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a511d7-e7d1-416f-ba94-ec8e45066395]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:33 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 Nov 03 17:14:33 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:33 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92" returned: 0 in 0.415s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf81b133-7a60-4832-9f6d-d31e54d79afb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aa486c-007e-4c51-85a0-7c5c4973a117]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:34 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb Nov 03 17:14:34 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Acquiring lock "cinder-fbe29c33-7973-48ad-9340-a3ca23b576a8-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Lock "cinder-fbe29c33-7973-48ad-9340-a3ca23b576a8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Acquiring lock "cinder-quobyte-fbe29c33-7973-48ad-9340-a3ca23b576a8" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Lock "cinder-quobyte-fbe29c33-7973-48ad-9340-a3ca23b576a8" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46f3512-4019-4d45-9079-c417a7826524]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:34 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb" returned: 0 in 0.391s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435 not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:34 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435 Nov 03 17:14:34 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:34 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 Nov 03 17:14:34 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:34 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8" returned: 0 in 0.406s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:34 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8 Nov 03 17:14:34 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:34 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fbe29c33-7973-48ad-9340-a3ca23b576a8" returned: 0 in 0.334s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Lock "cinder-quobyte-fbe29c33-7973-48ad-9340-a3ca23b576a8" released by "delete_volume" :: held 0.791s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:35 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Created reservations ['005db94f-a1d9-4532-9ed4-498fa4899d33', 'ffd8f67d-706f-4d01-80b0-1293473ae636', '5ce044dd-a44e-42d3-bf6b-392f3d5c7782', '48856bfb-e61b-41e3-8689-2eba147b05f0'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:35 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:14:35 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:35 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.687s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:36 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Deleted volume successfully. Nov 03 17:14:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5aae6e05-e2c5-4e80-bfe5-2d18dbfc49f9 tempest-TestImageHashVerification-1147621422 None] Lock "cinder-fbe29c33-7973-48ad-9340-a3ca23b576a8-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:41 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435" returned: 0 in 6.857s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435 {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:14:41 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Converted 1024.00 MB image at 149.31 MB/s Nov 03 17:14:41 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435 is being set with open permissions: ugo+rw Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:41 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435 Nov 03 17:14:41 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:41 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435" returned: 0 in 0.299s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-580626b5-c2b0-41a0-895b-2af287f77435" released by "_copy_volume_from_snapshot" :: held 8.066s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-be6cd551-c5b9-4904-b008-8e50d083ac92-580626b5-c2b0-41a0-895b-2af287f77435" released by "_create_volume_from_snapshot" :: held 8.150s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.199s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-3c13418f-76db-4883-8edf-d8d7558a93ef req-11f7c66f-0947-419c-8177-8e60973759b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 27.588s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-3c13418f-76db-4883-8edf-d8d7558a93ef req-11f7c66f-0947-419c-8177-8e60973759b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.249s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2020623596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ad5638-2cb1-421d-8df5-21fa5a519859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:15Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Creating volume 48ad5638-2cb1-421d-8df5-21fa5a519859 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:41 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:41 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 1073741824 Nov 03 17:14:41 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26958a3-96e3-494c-81c4-ec6ff9ec3073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580626b5-c2b0-41a0-895b-2af287f77435', 'volume_size': 1, 'snapshot_id': 'be6cd551-c5b9-4904-b008-8e50d083ac92'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a339f6-ed16-4d36-b487-c319af3211d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:41 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Volume volume-580626b5-c2b0-41a0-895b-2af287f77435 (580626b5-c2b0-41a0-895b-2af287f77435): created successfully Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a339f6-ed16-4d36-b487-c319af3211d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Flow 'volume_create_manager' (bf48b1c8-e3b6-41c1-960f-4bd48ea49c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-3c13418f-76db-4883-8edf-d8d7558a93ef req-11f7c66f-0947-419c-8177-8e60973759b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a837f759-4892-4768-b3a3-221108df0070', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:14:41 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2cfc1640-4d51-4d88-b63f-c3b049f882d4 tempest-VolumesSnapshotTestJSON-598074943 None] Created volume successfully. Nov 03 17:14:41 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-3c13418f-76db-4883-8edf-d8d7558a93ef req-11f7c66f-0947-419c-8177-8e60973759b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] attachment_update completed successfully. Nov 03 17:14:42 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 1073741824" returned: 0 in 0.515s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:42 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 Nov 03 17:14:42 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:42 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859" returned: 0 in 0.336s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14cd476d-7838-411e-94b5-2baec59f9185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ad5638-2cb1-421d-8df5-21fa5a519859', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ea7861-c320-4606-b8c7-67f391a04329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:42 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume volume-48ad5638-2cb1-421d-8df5-21fa5a519859 (48ad5638-2cb1-421d-8df5-21fa5a519859): created successfully Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ea7861-c320-4606-b8c7-67f391a04329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (0443b1fd-530d-4090-852f-50c325c355f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:42 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-19bc0f9c-aaf2-4c57-adc0-0ef9a7e16752 tempest-CreateVolumesFromSnapshotTest-377744643 None] Created volume successfully. Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-580626b5-c2b0-41a0-895b-2af287f77435-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-580626b5-c2b0-41a0-895b-2af287f77435-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-580626b5-c2b0-41a0-895b-2af287f77435" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-580626b5-c2b0-41a0-895b-2af287f77435" acquired by "delete_volume" :: waited 0.014s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f59eb1-4e63-4f03-8851-8caec9ed2e25]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:42 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435 Nov 03 17:14:42 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:43 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435" returned: 0 in 0.352s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:43 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435 Nov 03 17:14:43 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:43 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-580626b5-c2b0-41a0-895b-2af287f77435" returned: 0 in 0.268s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-580626b5-c2b0-41a0-895b-2af287f77435" released by "delete_volume" :: held 0.664s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Created reservations ['7d0cf719-bf90-4cdf-becd-59029ef3effd', 'a9702665-0b8a-4333-a09f-9260920a51be', '42faa67f-7219-4135-b030-86e6b0db2639', '5bff380a-7c9d-42a3-87d8-82dca7fa3623'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:43 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:14:43 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:43 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.362s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:43 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Deleted volume successfully. Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Creating offline snapshot 04a38f25-c9ed-477b-b49b-76c24b8b9970 of volume 48ad5638-2cb1-421d-8df5-21fa5a519859 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-271bc8db-9d31-4a0d-b2a8-71591564e150 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-580626b5-c2b0-41a0-895b-2af287f77435-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c39ac8-cf10-49b8-84d3-72e392aed650]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-be6cd551-c5b9-4904-b008-8e50d083ac92-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-be6cd551-c5b9-4904-b008-8e50d083ac92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-cf81b133-7a60-4832-9f6d-d31e54d79afb" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-cf81b133-7a60-4832-9f6d-d31e54d79afb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-be6cd551-c5b9-4904-b008-8e50d083ac92" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-be6cd551-c5b9-4904-b008-8e50d083ac92" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Deleting offline snapshot be6cd551-c5b9-4904-b008-8e50d083ac92 of volume cf81b133-7a60-4832-9f6d-d31e54d79afb {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] snapshot_file for this snap is: volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:14:44 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 Nov 03 17:14:44 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2039f79-eb7a-46e6-93ec-9b93d7912667]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 Nov 03 17:14:44 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:44 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859" returned: 0 in 0.514s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 1G Nov 03 17:14:44 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:44 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92" returned: 0 in 0.562s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf81b133-7a60-4832-9f6d-d31e54d79afb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[4920fccb-c5d9-4853-816c-3162950217fa]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:44 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb Nov 03 17:14:44 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-378d53d8-c664-48b7-9ad6-5b66d4362f67 req-7dcf0d70-1a8d-48f8-95ce-645a3fb6cbae tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:45 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 1G" returned: 0 in 0.615s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ad5638-2cb1-421d-8df5-21fa5a519859 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:45 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ad5638-2cb1-421d-8df5-21fa5a519859 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 Nov 03 17:14:45 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:45 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ad5638-2cb1-421d-8df5-21fa5a519859 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970" returned: 0 in 0.325s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:45 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 is being set with open permissions: ugo+rw Nov 03 17:14:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:45 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb" returned: 0 in 0.656s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:45 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 Nov 03 17:14:45 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:45 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 Nov 03 17:14:45 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:45 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970" returned: 0 in 0.336s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:45 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:45 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.info Nov 03 17:14:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92" returned: 0 in 0.385s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:45 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:45 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92 Nov 03 17:14:45 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:46 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.info" returned: 0 in 0.251s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:46 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.info is being set with open permissions: ugo+rw Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:46 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.info Nov 03 17:14:46 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:46 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb.be6cd551-c5b9-4904-b008-8e50d083ac92" returned: 0 in 0.269s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-be6cd551-c5b9-4904-b008-8e50d083ac92" released by "_delete_snapshot" :: held 2.068s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-cf81b133-7a60-4832-9f6d-d31e54d79afb" released by "delete_snapshot" :: held 2.099s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Created reservations ['6670e19d-f2ee-4912-9eee-428f30aac039', '4f1c7aab-0907-4c9e-a858-21f87b2f1b97', '5d8c68ae-9647-4f9a-8677-90b1d35887a9', '280e5e33-d4dd-402d-ac99-fafb113670d5'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:46 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Delete snapshot completed successfully. Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-048d8d8f-c435-4f87-a97a-3c78be0b7917 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-be6cd551-c5b9-4904-b008-8e50d083ac92-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:46 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.info" returned: 0 in 0.281s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-378d53d8-c664-48b7-9ad6-5b66d4362f67 req-7dcf0d70-1a8d-48f8-95ce-645a3fb6cbae tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.282s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-378d53d8-c664-48b7-9ad6-5b66d4362f67 req-7dcf0d70-1a8d-48f8-95ce-645a3fb6cbae tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:46 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ccd6663b-f405-4416-9159-f205397cc6e4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Create snapshot completed successfully Nov 03 17:14:46 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-378d53d8-c664-48b7-9ad6-5b66d4362f67 req-7dcf0d70-1a8d-48f8-95ce-645a3fb6cbae tempest-TestInstancesWithCinderVolumes-1014524844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a526f92c-efd6-4f5c-805e-1590290d9cc5', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:14:46 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-378d53d8-c664-48b7-9ad6-5b66d4362f67 req-7dcf0d70-1a8d-48f8-95ce-645a3fb6cbae tempest-TestInstancesWithCinderVolumes-1014524844 None] attachment_update completed successfully. Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-cf81b133-7a60-4832-9f6d-d31e54d79afb-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-cf81b133-7a60-4832-9f6d-d31e54d79afb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-cf81b133-7a60-4832-9f6d-d31e54d79afb" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-cf81b133-7a60-4832-9f6d-d31e54d79afb" acquired by "delete_volume" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[76121fc4-3c9b-469d-a192-51423790e266]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:47 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb Nov 03 17:14:47 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (4043f19c-209b-4802-af31-1f31de540db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54af926-d1c6-4539-8368-7db0254f4704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54af926-d1c6-4539-8368-7db0254f4704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026728616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a086b1-3cae-455e-b1dc-ea7f7bdda32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:48Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678451f4-3759-4600-a93d-a65300850d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678451f4-3759-4600-a93d-a65300850d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab679047-472b-4145-90ab-d17b0167e178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab679047-472b-4145-90ab-d17b0167e178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a086b1-3cae-455e-b1dc-ea7f7bdda32b', 'volume_name': 'volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d0167f-c7cb-43c9-8be4-1e3936f5cd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d0167f-c7cb-43c9-8be4-1e3936f5cd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa26343f-5e23-40b8-8ba9-b060fa371d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:47 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume b1a086b1-3cae-455e-b1dc-ea7f7bdda32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b', 'volume_size': 1} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026728616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a086b1-3cae-455e-b1dc-ea7f7bdda32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:48Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Creating volume b1a086b1-3cae-455e-b1dc-ea7f7bdda32b {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:47 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:14:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:48 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b 1073741824 Nov 03 17:14:48 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:48 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb" returned: 0 in 0.781s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:48 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb Nov 03 17:14:48 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (4772c4df-cb3e-4c05-a279-d075010e0e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9be428-29d2-4e5c-8919-fc5766bc87fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9be428-29d2-4e5c-8919-fc5766bc87fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145511885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6835638b-9e9d-4dab-9823-ad9eac47b26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:48Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4572eda6-d7f4-44ec-b6e2-9628c261d79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4572eda6-d7f4-44ec-b6e2-9628c261d79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e795345c-a9be-416f-93f9-4b00e692c150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e795345c-a9be-416f-93f9-4b00e692c150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6835638b-9e9d-4dab-9823-ad9eac47b26a', 'volume_name': 'volume-6835638b-9e9d-4dab-9823-ad9eac47b26a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23830d53-b1dd-4ff1-89b6-8371154fc7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23830d53-b1dd-4ff1-89b6-8371154fc7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc076f3-8397-462c-a25f-319eb7719446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:48 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume 6835638b-9e9d-4dab-9823-ad9eac47b26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6835638b-9e9d-4dab-9823-ad9eac47b26a', 'volume_size': 1} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:48 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cf81b133-7a60-4832-9f6d-d31e54d79afb" returned: 0 in 0.476s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-cf81b133-7a60-4832-9f6d-d31e54d79afb" released by "delete_volume" :: held 1.366s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:48 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b 1073741824" returned: 0 in 0.888s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:48 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Created reservations ['eb864c03-a4c8-4b8d-80c9-889cc8616299', '72ee4b37-1f85-4dcf-9b8e-4572ff769f29', '2187128e-438a-47b8-9dac-a1473593ee32', 'c7a2d7a2-5e00-4644-9343-9f4e6db10fbc'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:48 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b Nov 03 17:14:48 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:49 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:14:49 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:49 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b" returned: 0 in 0.410s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145511885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6835638b-9e9d-4dab-9823-ad9eac47b26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:48Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Creating volume 6835638b-9e9d-4dab-9823-ad9eac47b26a {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:49 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa26343f-5e23-40b8-8ba9-b060fa371d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f624b7de-7465-4b6c-a64b-7fcc3969065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:49 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a 1073741824 Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:49 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (176befeb-6eee-4430-a883-a0cb95c8db1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba58ebd-0028-49d3-99f2-04cabcd6e33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:49 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b (b1a086b1-3cae-455e-b1dc-ea7f7bdda32b): created successfully Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f624b7de-7465-4b6c-a64b-7fcc3969065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (4043f19c-209b-4802-af31-1f31de540db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba58ebd-0028-49d3-99f2-04cabcd6e33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-935018430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281abff2-b30c-4928-a44c-cbe060553c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:49Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af278ce-c558-4eba-bd65-5d62ddfdc379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af278ce-c558-4eba-bd65-5d62ddfdc379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccde343d-a36c-4df7-9756-9cf32874f0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccde343d-a36c-4df7-9756-9cf32874f0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '281abff2-b30c-4928-a44c-cbe060553c19', 'volume_name': 'volume-281abff2-b30c-4928-a44c-cbe060553c19', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fee9231-4e75-45e9-af36-5decbac8ab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fee9231-4e75-45e9-af36-5decbac8ab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f2bab7-36d4-419f-bae8-bde9d64b3ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:49 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume 281abff2-b30c-4928-a44c-cbe060553c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-281abff2-b30c-4928-a44c-cbe060553c19', 'volume_size': 1} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:49 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-36ea5139-61c2-40ca-8d53-cd3afece80b4 tempest-CreateVolumesFromSnapshotTest-377744643 None] Created volume successfully. Nov 03 17:14:49 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.490s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:49 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Deleted volume successfully. Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a90b6b89-7baa-4920-8509-34cc43ff8274 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-cf81b133-7a60-4832-9f6d-d31e54d79afb-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (d5fe45b4-16ce-4b28-820d-ace20437d296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35fef79-649a-4dd0-85dc-f64610a4cec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "cinder-quobyte-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:50 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35fef79-649a-4dd0-85dc-f64610a4cec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-167676501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83df28ea-79fa-414e-ac0c-d2b40932ffd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:50Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea70044-c6f1-49be-be87-2abf72bc2638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea70044-c6f1-49be-be87-2abf72bc2638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f4ad37-a4dc-445b-bb35-8c5de645802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f4ad37-a4dc-445b-bb35-8c5de645802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83df28ea-79fa-414e-ac0c-d2b40932ffd0', 'volume_name': 'volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ad0e0d-2ab5-4d54-8770-c3076175e5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ad0e0d-2ab5-4d54-8770-c3076175e5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771a06f3-70f1-4ace-8dab-36fdff02aa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:50 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume 83df28ea-79fa-414e-ac0c-d2b40932ffd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0', 'volume_size': 1} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb" acquired by "delete_volume" :: waited 0.099s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a 1073741824" returned: 0 in 0.914s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6afaa0-4b19-4669-98d6-3dfc52f0e53a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:50 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a Nov 03 17:14:50 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:50 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb Nov 03 17:14:50 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:50 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a" returned: 0 in 0.322s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.145s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-935018430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281abff2-b30c-4928-a44c-cbe060553c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:49Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Creating volume 281abff2-b30c-4928-a44c-cbe060553c19 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:50 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:50 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19 1073741824 Nov 03 17:14:50 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc076f3-8397-462c-a25f-319eb7719446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6835638b-9e9d-4dab-9823-ad9eac47b26a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bb4e9c-02a7-4845-b8d5-93933af7b4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:14:50 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (eb85729c-c070-42d6-a566-992b78191278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a52f02-ef8c-4971-8874-0ecfc5dce2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb" returned: 0 in 0.674s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:50 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume volume-6835638b-9e9d-4dab-9823-ad9eac47b26a (6835638b-9e9d-4dab-9823-ad9eac47b26a): created successfully Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bb4e9c-02a7-4845-b8d5-93933af7b4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (4772c4df-cb3e-4c05-a279-d075010e0e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:51 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb Nov 03 17:14:51 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a52f02-ef8c-4971-8874-0ecfc5dce2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-317482154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c120ff-150d-4a16-ad3b-4ef3a1c57c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:51Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4591c24-7f6e-40fb-935a-253737061fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4591c24-7f6e-40fb-935a-253737061fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4c01a1-73ce-4647-9e17-21365a5b47eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4c01a1-73ce-4647-9e17-21365a5b47eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0c120ff-150d-4a16-ad3b-4ef3a1c57c95', 'volume_name': 'volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2a3193-102c-4f1c-9707-eb4d95026f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2a3193-102c-4f1c-9707-eb4d95026f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c845aed6-6e06-4184-a9fa-45939a08eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:51 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume e0c120ff-150d-4a16-ad3b-4ef3a1c57c95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95', 'volume_size': 1} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:51 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c6745151-ebb9-4405-9184-8c815150620d tempest-CreateVolumesFromSnapshotTest-377744643 None] Created volume successfully. Nov 03 17:14:51 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19 1073741824" returned: 0 in 0.653s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:51 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb" returned: 0 in 0.375s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-quobyte-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb" released by "delete_volume" :: held 1.169s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:51 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19 Nov 03 17:14:51 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Created reservations ['1cb784f0-a186-4c8c-ad4b-a91dec1c7109', 'd3ad192b-6f7a-47ac-a69a-f626f58a7a49', '265771bb-7fa1-416c-988e-d1029e97b549', 'b80af0e7-3c49-48ad-9203-b638e0d60cfa'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:51 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:14:51 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:51 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19" returned: 0 in 0.306s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-167676501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83df28ea-79fa-414e-ac0c-d2b40932ffd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:50Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Creating volume 83df28ea-79fa-414e-ac0c-d2b40932ffd0 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:51 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f2bab7-36d4-419f-bae8-bde9d64b3ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281abff2-b30c-4928-a44c-cbe060553c19', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:51 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0 1073741824 Nov 03 17:14:51 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df643e5c-6ea2-405b-9fac-c57749f863b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:51 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume volume-281abff2-b30c-4928-a44c-cbe060553c19 (281abff2-b30c-4928-a44c-cbe060553c19): created successfully Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df643e5c-6ea2-405b-9fac-c57749f863b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (176befeb-6eee-4430-a883-a0cb95c8db1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:51 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-51abe0d2-0974-45db-8b6c-2df1ee6d7c64 tempest-CreateVolumesFromSnapshotTest-377744643 None] Created volume successfully. Nov 03 17:14:52 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.369s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:52 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Deleted volume successfully. Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-36500f4e-f0b4-4c09-bdc9-11dfe51fa485 tempest-VolumesSnapshotTestJSON-598074943 None] Lock "cinder-c714c1d4-9198-4ddb-b5dc-8326b71e4aeb-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:52 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0 1073741824" returned: 0 in 0.648s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:52 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0 Nov 03 17:14:52 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:52 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0" returned: 0 in 0.306s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-317482154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c120ff-150d-4a16-ad3b-4ef3a1c57c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa5f3d72a84098a56302b80e7f8a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:14:51Z,use_quota=True,user_id='09e5180a4b7f4de8bdef976fdfca99ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Creating volume e0c120ff-150d-4a16-ad3b-4ef3a1c57c95 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:14:52 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:52 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95 1073741824 Nov 03 17:14:52 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771a06f3-70f1-4ace-8dab-36fdff02aa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa28a33-2a48-48c1-95bf-00bad4d84338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:52 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0 (83df28ea-79fa-414e-ac0c-d2b40932ffd0): created successfully Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa28a33-2a48-48c1-95bf-00bad4d84338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (d5fe45b4-16ce-4b28-820d-ace20437d296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:52 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-fb27d862-400c-43ff-a6fa-b03bcd43db6a tempest-CreateVolumesFromSnapshotTest-377744643 None] Created volume successfully. Nov 03 17:14:53 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95 1073741824" returned: 0 in 0.850s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:53 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95 Nov 03 17:14:53 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:54 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95" returned: 0 in 0.318s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c845aed6-6e06-4184-a9fa-45939a08eda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af7700c-dfcc-4027-940d-b3369aeaf41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:14:54 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-56287a8a-a8c9-4419-9828-551eae1c4b5f req-0c8c26ca-8748-4675-a427-06a3589cf7b1 tempest-TestInstancesWithCinderVolumes-1014524844 None] Terminate volume connection completed successfully. Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-56287a8a-a8c9-4419-9828-551eae1c4b5f req-0c8c26ca-8748-4675-a427-06a3589cf7b1 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deleting attachment a837f759-4892-4768-b3a3-221108df0070. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:14:54 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Volume volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95 (e0c120ff-150d-4a16-ad3b-4ef3a1c57c95): created successfully Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af7700c-dfcc-4027-940d-b3369aeaf41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Flow 'volume_create_manager' (eb85729c-c070-42d6-a566-992b78191278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:14:54 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8ffb0f21-b440-4187-a3da-57efbb5e2d2d tempest-CreateVolumesFromSnapshotTest-377744643 None] Created volume successfully. Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-quobyte-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e259a97-8bfd-47b7-8b02-7299dbd1cd3e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "cinder-d6d59656-9d21-47ec-afa8-ae91b0ac10fb-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:54 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95 Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-d6d59656-9d21-47ec-afa8-ae91b0ac10fb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:54 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "cinder-quobyte-d6d59656-9d21-47ec-afa8-ae91b0ac10fb" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-quobyte-d6d59656-9d21-47ec-afa8-ae91b0ac10fb" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c45f191-783a-480b-8cc6-530343dfc23a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:55 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb Nov 03 17:14:55 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:55 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95" returned: 0 in 0.490s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:55 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95 Nov 03 17:14:55 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:55 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:55 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95" returned: 0 in 0.409s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb" returned: 0 in 0.609s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95" released by "delete_volume" :: held 1.002s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:55 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb Nov 03 17:14:55 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Created reservations ['113919b1-7949-434a-90b8-993b8fe618d8', 'd0d6167b-1ff7-4466-acc3-ca2c0fdb49d0', '47e6f390-fbd4-4597-90c4-2b6c04d71496', 'e6528fa1-9a91-4088-9380-2ad3fe1a73e8'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:55 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:14:55 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:55 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d6d59656-9d21-47ec-afa8-ae91b0ac10fb" returned: 0 in 0.398s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-quobyte-d6d59656-9d21-47ec-afa8-ae91b0ac10fb" released by "delete_volume" :: held 1.080s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:55 devstack cinder-volume[86661]: WARNING cinder.quota [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1258810964-352466066 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1258810964-352466066, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:14:55 devstack cinder-volume[86661]: WARNING cinder.quota [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1258810964-352466066 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1258810964-352466066, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Created reservations ['45ebf3f4-8663-40ea-a7e2-d966570594c5', '96d99b51-f3cf-46dc-826a-ee5924938ce2', '75f69d0a-8cf5-4aed-8041-deb45800081c', '215b6979-ad8f-41b9-92c7-b1fa8227e82d'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:56 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.324s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:56 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Deleted volume successfully. Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bad9dff2-dc6e-4ca3-b31c-381b90165681 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-e0c120ff-150d-4a16-ad3b-4ef3a1c57c95-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:56 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:14:56 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:56 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.347s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:56 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deleted volume successfully. Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ac90c0a9-da2b-4c14-8f10-ae6f1d3565b8 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-d6d59656-9d21-47ec-afa8-ae91b0ac10fb-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-83df28ea-79fa-414e-ac0c-d2b40932ffd0-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-83df28ea-79fa-414e-ac0c-d2b40932ffd0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-quobyte-83df28ea-79fa-414e-ac0c-d2b40932ffd0" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-83df28ea-79fa-414e-ac0c-d2b40932ffd0" acquired by "delete_volume" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[919ccc91-5031-4339-9981-477b05fd35ef]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:56 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0 Nov 03 17:14:56 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:57 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0" returned: 0 in 0.439s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:57 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0 Nov 03 17:14:57 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:57 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-83df28ea-79fa-414e-ac0c-d2b40932ffd0" returned: 0 in 0.431s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-83df28ea-79fa-414e-ac0c-d2b40932ffd0" released by "delete_volume" :: held 0.928s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:57 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Created reservations ['27de5add-32b1-4f86-b78a-751ccba06de7', '2c4a61be-e41c-421a-b83f-1a41a94b8168', '8af56191-83da-4ddc-b5a2-edcc17ce422b', '108e7512-e21d-450e-9cea-cf7edf75cb19'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:58 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:14:58 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-281abff2-b30c-4928-a44c-cbe060553c19-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-281abff2-b30c-4928-a44c-cbe060553c19-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-quobyte-281abff2-b30c-4928-a44c-cbe060553c19" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:14:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-281abff2-b30c-4928-a44c-cbe060553c19" acquired by "delete_volume" :: waited 0.033s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:14:58 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4aa466-66b0-4b6f-ae1e-404c1aad7a9d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:14:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:58 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.560s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:58 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:14:58 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19 Nov 03 17:14:58 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Deleted volume successfully. Nov 03 17:14:58 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c90c6afb-e4f9-49c2-960b-2c282b11d2f9 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-83df28ea-79fa-414e-ac0c-d2b40932ffd0-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:58 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19" returned: 0 in 0.631s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:58 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19 Nov 03 17:14:58 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:59 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Nov 03 17:14:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-281abff2-b30c-4928-a44c-cbe060553c19" returned: 0 in 0.433s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:14:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-281abff2-b30c-4928-a44c-cbe060553c19" released by "delete_volume" :: held 1.152s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:14:59 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Created reservations ['c188ef6e-a0ea-4586-a458-70e9d655f452', 'dbe3de48-6ca1-40d6-919e-884094870e4f', 'd43b09a6-2548-47db-bbca-2efed489a424', '19ca6483-14e6-4728-8142-26d79d79d3fa'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:14:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:14:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:14:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:14:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:14:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:14:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:14:59 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:14:59 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:14:59 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-26cd4306-038d-4889-8d81-9833aa21d3bd req-727677cd-d390-4e18-9995-075750f1bf99 tempest-TestInstancesWithCinderVolumes-1014524844 None] Terminate volume connection completed successfully. Nov 03 17:14:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-26cd4306-038d-4889-8d81-9833aa21d3bd req-727677cd-d390-4e18-9995-075750f1bf99 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deleting attachment a526f92c-efd6-4f5c-805e-1590290d9cc5. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:14:59 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.387s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:00 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Deleted volume successfully. Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-915380b0-16a5-4a55-803b-baedce655ec7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-281abff2-b30c-4928-a44c-cbe060553c19-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-6835638b-9e9d-4dab-9823-ad9eac47b26a-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "cinder-fa83fea1-08ca-4b89-b055-a9bdaf235a4e-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-6835638b-9e9d-4dab-9823-ad9eac47b26a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-fa83fea1-08ca-4b89-b055-a9bdaf235a4e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-quobyte-6835638b-9e9d-4dab-9823-ad9eac47b26a" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-6835638b-9e9d-4dab-9823-ad9eac47b26a" acquired by "delete_volume" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dc40ae-df0b-4fcd-97e3-129eda43e3a1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "cinder-quobyte-fa83fea1-08ca-4b89-b055-a9bdaf235a4e" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-quobyte-fa83fea1-08ca-4b89-b055-a9bdaf235a4e" acquired by "delete_volume" :: waited 0.076s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:00 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a Nov 03 17:15:00 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c6c158-57bd-4177-a081-69075ed0f2f3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:01 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e Nov 03 17:15:01 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:01 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a" returned: 0 in 0.714s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:01 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a Nov 03 17:15:01 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:01 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e" returned: 0 in 0.698s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:01 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e Nov 03 17:15:01 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:01 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6835638b-9e9d-4dab-9823-ad9eac47b26a" returned: 0 in 0.413s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-6835638b-9e9d-4dab-9823-ad9eac47b26a" released by "delete_volume" :: held 1.214s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:01 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Created reservations ['c1dc04a1-fb17-40eb-9d63-087c20a50c7c', '434b9203-4f87-4756-b121-337b60ce9666', 'cf52f464-7242-4f7d-af64-7a7319de3581', '871396cc-77b1-4dff-b848-b9e7a69c4384'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:02 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa83fea1-08ca-4b89-b055-a9bdaf235a4e" returned: 0 in 0.515s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:02 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:15:02 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-quobyte-fa83fea1-08ca-4b89-b055-a9bdaf235a4e" released by "delete_volume" :: held 1.314s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:02 devstack cinder-volume[86661]: WARNING cinder.quota [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-996785996-715242846 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-996785996-715242846, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:15:02 devstack cinder-volume[86661]: WARNING cinder.quota [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-996785996-715242846 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-996785996-715242846, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Created reservations ['f4953e66-234a-4ecb-a4de-ceace7a15e0e', '776dda92-4521-41a4-ac02-adb33f900349', '6e949952-79a6-4bcf-8e63-3d44d1b51c8d', '44e48385-3922-47bf-ad2b-e9ec1c19f1d1'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:02 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:15:02 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:02 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.515s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Deleted volume successfully. Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7a63c835-e247-4452-b13b-6549e4c75103 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-6835638b-9e9d-4dab-9823-ad9eac47b26a-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:02 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.432s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deleted volume successfully. Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c890e0a5-c20e-4a47-8d30-c3bfe8ecc826 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-fa83fea1-08ca-4b89-b055-a9bdaf235a4e-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-quobyte-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b" acquired by "delete_volume" :: waited 0.038s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:03 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[33727b1b-48da-4af2-ae2e-2a1c179e8121]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:03 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b Nov 03 17:15:03 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:03 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b" returned: 0 in 0.602s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:03 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b Nov 03 17:15:03 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:04 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b" returned: 0 in 0.457s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b" released by "delete_volume" :: held 1.142s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Created reservations ['bd3a53b0-aaec-47bb-a678-ba78b348028c', '0da4b1cc-8005-4a8e-b8e8-7f5860843434', '5872bf93-0250-476d-968c-a8d06a5537b1', '5d574d12-07c8-476a-88d4-7e5b8ed18ec2'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:04 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:15:04 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:04 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.427s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Deleted volume successfully. Nov 03 17:15:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c29eb702-20e7-4091-aea8-ef358f285a7f tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-b1a086b1-3cae-455e-b1dc-ea7f7bdda32b-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Flow 'volume_create_manager' (1e2de3d4-746a-4c81-9af6-aa6efc892f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8b5709-96bc-4756-9bf4-6cf44e97d5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8b5709-96bc-4756-9bf4-6cf44e97d5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-605897709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d04b4fe-d262-4cab-91e9-4139c0a866d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f31be2b2234a439bc29ff603715628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:05Z,use_quota=True,user_id='ebc5c7cc0e8d43588c21bfb91925d2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0bf95d-29a2-4fa7-82c7-ffa650c2c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0bf95d-29a2-4fa7-82c7-ffa650c2c9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f4a24d-fdb8-4853-8353-6e5df3dafb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f4a24d-fdb8-4853-8353-6e5df3dafb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d04b4fe-d262-4cab-91e9-4139c0a866d8', 'volume_name': 'volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68869569-30fb-4cb1-a57f-c68f98fde24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68869569-30fb-4cb1-a57f-c68f98fde24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af50f80-632c-416b-b6b4-57014ba7b5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:05 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Volume 3d04b4fe-d262-4cab-91e9-4139c0a866d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8', 'volume_size': 1} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-605897709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d04b4fe-d262-4cab-91e9-4139c0a866d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f31be2b2234a439bc29ff603715628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:05Z,use_quota=True,user_id='ebc5c7cc0e8d43588c21bfb91925d2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Creating volume 3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:05 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-04a38f25-c9ed-477b-b49b-76c24b8b9970-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-04a38f25-c9ed-477b-b49b-76c24b8b9970-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-quobyte-48ad5638-2cb1-421d-8df5-21fa5a519859" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:05 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 1073741824 Nov 03 17:15:05 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-48ad5638-2cb1-421d-8df5-21fa5a519859" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-quobyte-04a38f25-c9ed-477b-b49b-76c24b8b9970" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-04a38f25-c9ed-477b-b49b-76c24b8b9970" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Deleting offline snapshot 04a38f25-c9ed-477b-b49b-76c24b8b9970 of volume 48ad5638-2cb1-421d-8df5-21fa5a519859 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] snapshot_file for this snap is: volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf3f691-7477-4c9a-aca1-a3c2609be9d0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:05 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 Nov 03 17:15:05 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:06 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 1073741824" returned: 0 in 0.797s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:06 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970" returned: 0 in 0.646s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ad5638-2cb1-421d-8df5-21fa5a519859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dc76e3-b80c-482b-b9a6-31a9b2e4ea60]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:06 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 Nov 03 17:15:06 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:06 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 Nov 03 17:15:06 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:06 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8" returned: 0 in 0.383s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af50f80-632c-416b-b6b4-57014ba7b5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38581c37-ae9a-40ff-9891-c21964c75766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:06 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Volume volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 (3d04b4fe-d262-4cab-91e9-4139c0a866d8): created successfully Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38581c37-ae9a-40ff-9891-c21964c75766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Flow 'volume_create_manager' (1e2de3d4-746a-4c81-9af6-aa6efc892f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:06 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f2d5e089-d0c1-4887-8eea-5a2c2f16adce tempest-VolumesSnapshotListTestJSON-1979374756 None] Created volume successfully. Nov 03 17:15:06 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-53d364dd-3595-4182-998a-9913e8e90d50 req-450f1b0c-11ba-4136-9a3f-d98a1ae92391 tempest-TestInstancesWithCinderVolumes-1014524844 None] Terminate volume connection completed successfully. Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-53d364dd-3595-4182-998a-9913e8e90d50 req-450f1b0c-11ba-4136-9a3f-d98a1ae92391 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deleting attachment c5cfe0fd-03dd-4f42-866f-2541adf3a856. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:15:06 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859" returned: 0 in 0.650s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:07 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 Nov 03 17:15:07 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:07 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970" returned: 0 in 0.480s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:07 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970 Nov 03 17:15:07 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] Creating offline snapshot db76a20d-71b2-468a-9c8b-b1add7920529 of volume 3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:15:07 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92f583e-9809-4d48-bbfb-0d5cf84ba9d1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:07 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 Nov 03 17:15:07 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:07 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859.04a38f25-c9ed-477b-b49b-76c24b8b9970" returned: 0 in 0.418s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-04a38f25-c9ed-477b-b49b-76c24b8b9970" released by "_delete_snapshot" :: held 2.373s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-48ad5638-2cb1-421d-8df5-21fa5a519859" released by "delete_snapshot" :: held 2.419s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Created reservations ['ec9e8c6b-5cb0-480c-b53e-90e3acb8b17b', 'eab90ee8-7c92-4cc1-9de8-c5939620f070', 'fd3b0a8e-baee-423b-ae8c-61e63cd52c94', '92f4e0ef-e513-4cd9-b624-f84ab5937c56'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:08 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8" returned: 0 in 0.508s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:08 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Delete snapshot completed successfully. Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-80597ce1-c947-4222-b343-659f392940de tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-04a38f25-c9ed-477b-b49b-76c24b8b9970-delete_snapshot" released by "delete_snapshot" :: held 2.623s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:08 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 1G Nov 03 17:15:08 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "cinder-a94e3db0-0e77-47dd-9e99-e7d065ada95c-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-a94e3db0-0e77-47dd-9e99-e7d065ada95c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "cinder-quobyte-a94e3db0-0e77-47dd-9e99-e7d065ada95c" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-quobyte-a94e3db0-0e77-47dd-9e99-e7d065ada95c" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f9980b-83e2-4d9e-aa07-93710e4ef893]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-48ad5638-2cb1-421d-8df5-21fa5a519859-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-48ad5638-2cb1-421d-8df5-21fa5a519859-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:08 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c Nov 03 17:15:08 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "cinder-quobyte-48ad5638-2cb1-421d-8df5-21fa5a519859" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:08 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 1G" returned: 0 in 0.676s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-48ad5638-2cb1-421d-8df5-21fa5a519859" acquired by "delete_volume" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:08 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 Nov 03 17:15:08 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2805f659-d800-48bf-a4db-fdc6ba2f94c5]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:09 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 Nov 03 17:15:09 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:09 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c" returned: 0 in 0.516s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:09 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c Nov 03 17:15:09 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:09 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529" returned: 0 in 0.374s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 is being set with open permissions: ugo+rw Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:09 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 Nov 03 17:15:09 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:09 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859" returned: 0 in 0.536s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:09 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859 Nov 03 17:15:09 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:09 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a94e3db0-0e77-47dd-9e99-e7d065ada95c" returned: 0 in 0.374s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-quobyte-a94e3db0-0e77-47dd-9e99-e7d065ada95c" released by "delete_volume" :: held 0.944s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:09 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529" returned: 0 in 0.366s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack cinder-volume[86661]: WARNING cinder.quota [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-692730359-1468135280 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-692730359-1468135280, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:15:09 devstack cinder-volume[86661]: WARNING cinder.quota [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-692730359-1468135280 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-692730359-1468135280, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Created reservations ['ec635c3e-c4ee-49f9-882f-e846f5bc3526', '81d8b271-083a-4905-8fc7-8a173a372dcd', 'bce6c2fd-b3bc-443b-bad8-17d71def4a00', '3e2de1ba-647e-4ddd-a28c-efe4ff32766b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:09 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.info Nov 03 17:15:09 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:09 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48ad5638-2cb1-421d-8df5-21fa5a519859" returned: 0 in 0.361s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:15:09 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-quobyte-48ad5638-2cb1-421d-8df5-21fa5a519859" released by "delete_volume" :: held 1.006s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Created reservations ['6977e1ee-4643-489e-967a-8c9f6d670ea6', '88c2842c-21a6-4095-9d41-5bf0ca0731b1', 'dc784810-8020-46a3-b850-026eeabe9fda', 'e57f119c-7a11-4842-8596-8d61dce959ef'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:09 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.info" returned: 0 in 0.363s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:09 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.info is being set with open permissions: ugo+rw Nov 03 17:15:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:10 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.info Nov 03 17:15:10 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:10 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:15:10 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:10 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.368s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:10 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Deleted volume successfully. Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d22e7266-4f20-4091-808e-3e28957fe352 tempest-TestInstancesWithCinderVolumes-1014524844 None] Lock "cinder-a94e3db0-0e77-47dd-9e99-e7d065ada95c-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:10 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.info" returned: 0 in 0.378s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:10 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.822s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.339s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:10 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Deleted volume successfully. Nov 03 17:15:10 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-514b5fe3-e7bb-45d9-a523-53ce932ea385 tempest-VolumesSnapshotListTestJSON-1979374756 None] Create snapshot completed successfully Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-9c371afc-b01d-43e0-b0ea-3163dbaad3e7 tempest-CreateVolumesFromSnapshotTest-377744643 None] Lock "cinder-48ad5638-2cb1-421d-8df5-21fa5a519859-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] Creating offline snapshot b593458e-ae1a-40d2-8d1f-81e543839303 of volume 3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:15:11 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dbb469-53e3-4901-84ab-11587f4cff8d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:11 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 Nov 03 17:15:11 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:11 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529" returned: 0 in 0.535s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:11 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 1G Nov 03 17:15:11 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:12 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 1G" returned: 0 in 0.746s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:12 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 Nov 03 17:15:12 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:12 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303" returned: 0 in 0.392s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:12 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 is being set with open permissions: ugo+rw Nov 03 17:15:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:12 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 Nov 03 17:15:12 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:13 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303" returned: 0 in 0.274s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:13 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-0b6b9a16-592c-4276-9913-856f58597258 tempest-VolumesSnapshotListTestJSON-1979374756 None] Create snapshot completed successfully Nov 03 17:15:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] Creating offline snapshot b3a5ce33-0237-4bd7-a90b-774149e10278 of volume 3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:15:14 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb0c56a-3d82-4273-8c57-81ac52a83455]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:14 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 Nov 03 17:15:14 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:15 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303" returned: 0 in 0.409s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:15 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 1G Nov 03 17:15:15 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:15 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 1G" returned: 0 in 0.683s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:15 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 Nov 03 17:15:15 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:16 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278" returned: 0 in 0.363s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:16 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 is being set with open permissions: ugo+rw Nov 03 17:15:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:16 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 Nov 03 17:15:16 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:16 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278" returned: 0 in 0.442s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:16 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ad9963ce-1b36-49b6-9ee1-199e050200ef tempest-VolumesSnapshotListTestJSON-1979374756 None] Create snapshot completed successfully Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "cinder-b3a5ce33-0237-4bd7-a90b-774149e10278-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-b3a5ce33-0237-4bd7-a90b-774149e10278-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "cinder-quobyte-b3a5ce33-0237-4bd7-a90b-774149e10278" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-b3a5ce33-0237-4bd7-a90b-774149e10278" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Deleting offline snapshot b3a5ce33-0237-4bd7-a90b-774149e10278 of volume 3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] snapshot_file for this snap is: volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbd21ea-8d2a-4b2e-ba65-d35240079d79]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:18 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 Nov 03 17:15:18 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:18 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278" returned: 0 in 0.520s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b4ab7b-f92d-49be-94be-da5d0147392a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:19 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 Nov 03 17:15:19 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:19 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303" returned: 0 in 0.754s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:19 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 Nov 03 17:15:19 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:20 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278" returned: 0 in 0.707s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:20 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278 Nov 03 17:15:20 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Flow 'volume_create_manager' (cc5e0b57-07ea-42ab-a1e5-ce1d9f5d0c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312126b7-821f-43bd-955e-fdbe00f87a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312126b7-821f-43bd-955e-fdbe00f87a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6424ddd-bb3a-4bc5-bd61-68f218af9175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7461bd0e822d4b3ba7d59ff3664f41b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:20Z,use_quota=True,user_id='a7fe288e443040de90829c0faaec3320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063dd6df-5324-4c0a-81c1-3ba853636744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063dd6df-5324-4c0a-81c1-3ba853636744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798707a1-a4ee-4f49-a6b2-17ac4bdebc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG cinder.image.glance [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Creating Keystone auth plugin from conf {{(pid=86661) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:15:20 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b3a5ce33-0237-4bd7-a90b-774149e10278" returned: 0 in 0.430s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-b3a5ce33-0237-4bd7-a90b-774149e10278" released by "_delete_snapshot" :: held 2.577s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" released by "delete_snapshot" :: held 2.610s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Created reservations ['b0c8ed62-ffa2-443f-ae94-e69f5d6f10b2', 'd4f079ce-0462-4002-a975-59563df5bd9a', 'd192996d-5397-4da8-b780-f3acbaf331ff', '248c4c39-7656-4d07-ac81-c743b0929f9a'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798707a1-a4ee-4f49-a6b2-17ac4bdebc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6424ddd-bb3a-4bc5-bd61-68f218af9175', 'volume_name': 'volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175', 'volume_size': 1, 'image_id': '5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78b1192a2212caf2904841b55b7b9b87', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7461bd0e822d4b3ba7d59ff3664f41b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13b19bcae6d25b832f7f0061d74ca81ff413b5c72bc4b1c5c1e02d6eceb56394e414ea59d2ba2fb9d5f698e26c241fed203f140431cf5997860fe8b962517575', 'id': '5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'created_at': datetime.datetime(2026, 11, 3, 16, 15, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 15, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9/file', 'properties': {}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54a3bed-9c87-4ea6-a1ec-bae595af264a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54a3bed-9c87-4ea6-a1ec-bae595af264a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4bd5cf-d149-41e7-a0f7-675e41bd2914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:21 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Volume c6424ddd-bb3a-4bc5-bd61-68f218af9175: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175', 'volume_size': 1, 'image_id': '5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78b1192a2212caf2904841b55b7b9b87', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7461bd0e822d4b3ba7d59ff3664f41b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13b19bcae6d25b832f7f0061d74ca81ff413b5c72bc4b1c5c1e02d6eceb56394e414ea59d2ba2fb9d5f698e26c241fed203f140431cf5997860fe8b962517575', 'id': '5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'created_at': datetime.datetime(2026, 11, 3, 16, 15, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 15, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9/file', 'properties': {}}, 'image_service': } Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Trying to clone c6424ddd-bb3a-4bc5-bd61-68f218af9175 from image 5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'metadata': {}}]). {{(pid=86661) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:15:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Delete snapshot completed successfully. Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ce35f442-7a51-45f0-8103-b04ca10db803 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-b3a5ce33-0237-4bd7-a90b-774149e10278-delete_snapshot" released by "delete_snapshot" :: held 2.886s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:15:21 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bc566f-8f4e-473d-95b0-b3c6c72e4856]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:21 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD Nov 03 17:15:21 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "cinder-b593458e-ae1a-40d2-8d1f-81e543839303-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-b593458e-ae1a-40d2-8d1f-81e543839303-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "cinder-quobyte-b593458e-ae1a-40d2-8d1f-81e543839303" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-b593458e-ae1a-40d2-8d1f-81e543839303" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Deleting offline snapshot b593458e-ae1a-40d2-8d1f-81e543839303 of volume 3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] snapshot_file for this snap is: volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58f9cc9-1be6-48a0-b8a5-04544dceb5f5]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:21 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 Nov 03 17:15:21 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:21 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD" returned: 0 in 0.596s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:22 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD Nov 03 17:15:22 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:22 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303" returned: 0 in 0.602s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e09d316-ffcf-49f7-89c5-fe0e33ac4e6f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:22 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD" returned: 1 in 0.547s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Temporary image 5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9 is fetched for user a7fe288e443040de90829c0faaec3320. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:15:22 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 Nov 03 17:15:22 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a71c2e2-993c-48a2-97c1-cf6b17a7f5c3]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:22 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD Nov 03 17:15:22 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:22 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529" returned: 0 in 0.523s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:22 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 Nov 03 17:15:22 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:23 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:23 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD Nov 03 17:15:23 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:23 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303" returned: 0 in 0.549s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:23 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303 Nov 03 17:15:23 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:23 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD" returned: 1 in 0.508s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6424ddd-bb3a-4bc5-bd61-68f218af9175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7461bd0e822d4b3ba7d59ff3664f41b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:20Z,use_quota=True,user_id='a7fe288e443040de90829c0faaec3320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Creating volume c6424ddd-bb3a-4bc5-bd61-68f218af9175 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:23 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:23 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 1073741824 Nov 03 17:15:23 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:23 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.b593458e-ae1a-40d2-8d1f-81e543839303" returned: 0 in 0.419s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-b593458e-ae1a-40d2-8d1f-81e543839303" released by "_delete_snapshot" :: held 2.241s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" released by "delete_snapshot" :: held 2.274s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:24 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Created reservations ['8480fdb0-d3f6-4218-a191-fb7954c2246c', '5963c8e9-1ff3-4c2d-beb5-da9e1a2b4e21', '4c9c2ffe-8753-46b0-834b-fa31d4c74119', '2fc940a8-ef2a-4e70-9799-a4a0a5326ebd'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Delete snapshot completed successfully. Nov 03 17:15:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7b8ad4de-ff2f-4a71-9a18-e040f57b28c4 tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-b593458e-ae1a-40d2-8d1f-81e543839303-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:24 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 1073741824" returned: 0 in 0.643s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:24 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 Nov 03 17:15:24 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:24 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175" returned: 0 in 0.324s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:24 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Attempting download of 5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'metadata': {}}])) to volume c6424ddd-bb3a-4bc5-bd61-68f218af9175. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:15:24 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8a4ade-851e-4267-b3da-995db396409a]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_tr8cbypl {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "cinder-db76a20d-71b2-468a-9c8b-b1add7920529-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-db76a20d-71b2-468a-9c8b-b1add7920529-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "cinder-quobyte-db76a20d-71b2-468a-9c8b-b1add7920529" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:25 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_tr8cbypl Nov 03 17:15:25 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-db76a20d-71b2-468a-9c8b-b1add7920529" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Deleting offline snapshot db76a20d-71b2-468a-9c8b-b1add7920529 of volume 3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] snapshot_file for this snap is: volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0f7fa5-b43a-4c2c-a830-6dae01d66f2d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:25 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 Nov 03 17:15:25 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:25 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_tr8cbypl" returned: 0 in 0.590s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_tr8cbypl {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:25 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_tr8cbypl Nov 03 17:15:25 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:25 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529" returned: 0 in 0.586s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7367114-7537-4f6c-832b-02620f448051]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:25 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_tr8cbypl" returned: 1 in 0.545s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_tr8cbypl' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[32954797-7f16-457b-a069-5d4441f98cf9]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:25 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 Nov 03 17:15:25 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:26 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD Nov 03 17:15:26 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:26 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8" returned: 0 in 0.693s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:26 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:26 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 Nov 03 17:15:26 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:26 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD Nov 03 17:15:26 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:27 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD" returned: 1 in 0.584s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] 5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9 was raw, converting to qcow2 {{(pid=86661) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:27 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529" returned: 0 in 0.636s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:27 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 Nov 03 17:15:27 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529 Nov 03 17:15:27 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:27 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:27 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8.db76a20d-71b2-468a-9c8b-b1add7920529" returned: 0 in 0.445s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=127,cinder:INSERT=36,cinder:UPDATE=160,cinder:DELETE=12 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=137,cinder:UPDATE=161,cinder:INSERT=44,cinder:DELETE=13 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-db76a20d-71b2-468a-9c8b-b1add7920529" released by "_delete_snapshot" :: held 2.557s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" released by "delete_snapshot" :: held 2.598s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Created reservations ['4c86603a-bafc-4730-9593-aad91539f263', '373ff90a-63df-4589-b18a-b714041ea7b9', 'a5dad643-c9ce-4da2-abcb-339ed4f2be74', '25da20b9-2e46-4f6c-b520-d54b7051f960'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Delete snapshot completed successfully. Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-11a960d6-d8e0-4c27-bc3d-fc24c6145e6e tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-db76a20d-71b2-468a-9c8b-b1add7920529-delete_snapshot" released by "delete_snapshot" :: held 2.883s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:27 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175" returned: 0 in 0.800s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9_owp7am5ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:15:27 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:15:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:27 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 1G Nov 03 17:15:27 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:28 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 1G" returned: 0 in 0.440s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Downloaded image 5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'metadata': {}}])) to volume c6424ddd-bb3a-4bc5-bd61-68f218af9175 successfully. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Temporary image 5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9 for user a7fe288e443040de90829c0faaec3320 is deleted. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Marking volume c6424ddd-bb3a-4bc5-bd61-68f218af9175 as bootable. {{(pid=86661) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Copying metadata from image 5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9 to c6424ddd-bb3a-4bc5-bd61-68f218af9175. {{(pid=86661) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Creating volume glance metadata for volume c6424ddd-bb3a-4bc5-bd61-68f218af9175 backed by image 5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9 with: {'image_id': '5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '78b1192a2212caf2904841b55b7b9b87', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86661) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "cinder-3d04b4fe-d262-4cab-91e9-4139c0a866d8-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4bd5cf-d149-41e7-a0f7-675e41bd2914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175', 'volume_size': 1, 'image_id': '5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78b1192a2212caf2904841b55b7b9b87', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7461bd0e822d4b3ba7d59ff3664f41b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '13b19bcae6d25b832f7f0061d74ca81ff413b5c72bc4b1c5c1e02d6eceb56394e414ea59d2ba2fb9d5f698e26c241fed203f140431cf5997860fe8b962517575', 'id': '5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9', 'created_at': datetime.datetime(2026, 11, 3, 16, 15, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 15, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5095cd5b-0b8d-435a-a9e4-c3a65fb05eb9/file', 'properties': {}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc18f8be-ca19-4321-9a47-2e9f0fa82b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-3d04b4fe-d262-4cab-91e9-4139c0a866d8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:28 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Volume volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 (c6424ddd-bb3a-4bc5-bd61-68f218af9175): created successfully Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc18f8be-ca19-4321-9a47-2e9f0fa82b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Flow 'volume_create_manager' (cc5e0b57-07ea-42ab-a1e5-ce1d9f5d0c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:28 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b33aee5e-c9f9-475b-9c31-be6663eb39d2 tempest-VolumeImageDependencyTests-789146226 None] Created volume successfully. Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[454777f2-4810-4d23-9ee7-8facb5cdcce8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:28 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 Nov 03 17:15:28 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:29 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8" returned: 0 in 0.573s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:29 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8 Nov 03 17:15:29 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Acquiring lock "cinder-c6424ddd-bb3a-4bc5-bd61-68f218af9175-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Lock "cinder-c6424ddd-bb3a-4bc5-bd61-68f218af9175-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Acquiring lock "cinder-quobyte-c6424ddd-bb3a-4bc5-bd61-68f218af9175" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Lock "cinder-quobyte-c6424ddd-bb3a-4bc5-bd61-68f218af9175" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3cf938-a88c-4e59-a0aa-cee81a57395e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:29 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3d04b4fe-d262-4cab-91e9-4139c0a866d8" returned: 0 in 0.333s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-quobyte-3d04b4fe-d262-4cab-91e9-4139c0a866d8" released by "delete_volume" :: held 1.003s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:29 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 Nov 03 17:15:29 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Created reservations ['ee584c5e-995b-43a4-a996-11a2c512816c', 'fdbd90eb-8bac-4a43-b3e3-7b3c4afcbe3d', '7db6b9da-1ea3-46fe-980b-2d3fd0f59757', '7d2aea63-af49-42a4-9d7b-9b5ff10e7f04'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:29 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:15:29 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:29 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:15:29 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:30 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.334s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:15:30 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175" returned: 0 in 0.620s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:30 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.338s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:30 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175 Nov 03 17:15:30 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Deleted volume successfully. Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8b1e9fce-16d5-4825-91a3-b9ddff9f646b tempest-VolumesSnapshotListTestJSON-1979374756 None] Lock "cinder-3d04b4fe-d262-4cab-91e9-4139c0a866d8-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:30 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-c6424ddd-bb3a-4bc5-bd61-68f218af9175" returned: 0 in 0.304s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Lock "cinder-quobyte-c6424ddd-bb3a-4bc5-bd61-68f218af9175" released by "delete_volume" :: held 0.990s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Created reservations ['2ea2e380-7af9-41cc-a3dd-00337969b9e0', 'e3d7e418-d747-4c99-b114-b1575aafa842', '580823af-387c-477a-a40d-3f48096fdf63', '5f497669-9fa5-413e-982c-4ff252915ae9'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:30 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:15:30 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:30 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Flow 'volume_create_manager' (d8113ef0-6f7f-4d82-be6c-7958faf18ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e77c60c-fde2-44d6-b908-142e64dcf497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.299s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e77c60c-fde2-44d6-b908-142e64dcf497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1508724200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b347e638-dbeb-44c5-ae5b-7c5598bd4e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a975efccb467585bd43dd7c3dfa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:31Z,use_quota=True,user_id='7b6c3347c37e467a91fc39322486d0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f6788a-000b-43e4-9b94-f474f4db13d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f6788a-000b-43e4-9b94-f474f4db13d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ce1fe4-d988-49de-9815-8e4276c1f8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ce1fe4-d988-49de-9815-8e4276c1f8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b347e638-dbeb-44c5-ae5b-7c5598bd4e6f', 'volume_name': 'volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793c3a6a-04ca-4a16-a0dd-14a22c300299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793c3a6a-04ca-4a16-a0dd-14a22c300299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b233c90-9f86-4999-a368-bc0edb1e93cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:31 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Volume b347e638-dbeb-44c5-ae5b-7c5598bd4e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f', 'volume_size': 1} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1508724200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b347e638-dbeb-44c5-ae5b-7c5598bd4e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a975efccb467585bd43dd7c3dfa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:31Z,use_quota=True,user_id='7b6c3347c37e467a91fc39322486d0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Creating volume b347e638-dbeb-44c5-ae5b-7c5598bd4e6f {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:31 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:31 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Deleted volume successfully. Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-14b677ee-33a6-4f6e-b454-3c634d6bf81f tempest-VolumeImageDependencyTests-789146226 None] Lock "cinder-c6424ddd-bb3a-4bc5-bd61-68f218af9175-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:31 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f 1073741824 Nov 03 17:15:31 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:31 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f 1073741824" returned: 0 in 0.796s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:31 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f Nov 03 17:15:31 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:32 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" returned: 0 in 0.290s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b233c90-9f86-4999-a368-bc0edb1e93cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d08da16-d530-446b-b04f-7d7bd63f570e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:32 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Volume volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f (b347e638-dbeb-44c5-ae5b-7c5598bd4e6f): created successfully Nov 03 17:15:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d08da16-d530-446b-b04f-7d7bd63f570e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Flow 'volume_create_manager' (d8113ef0-6f7f-4d82-be6c-7958faf18ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:32 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7e1e8bf3-ae66-40b0-979d-a99b1c1c2825 tempest-TestStampPattern-1336895651 None] Created volume successfully. Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Flow 'volume_create_manager' (f41bb359-f4d0-41a5-bfea-aacc07deb094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a76fc0-0d5c-4874-81fe-a33a7c61e18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a76fc0-0d5c-4874-81fe-a33a7c61e18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf87e5f-6f70-4d35-bd62-b09bf8f48b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b469dcda0f4b5b8289516476b626ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:37Z,use_quota=True,user_id='28bf981068ba4002821935f5351f35da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e471f6-b70a-49ae-a7ef-da0439aca69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e471f6-b70a-49ae-a7ef-da0439aca69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c214cd-5d15-42e7-813f-cf696c750d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c214cd-5d15-42e7-813f-cf696c750d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf87e5f-6f70-4d35-bd62-b09bf8f48b04', 'volume_name': 'volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32877ede-74da-47f7-9a69-32419cbc2459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32877ede-74da-47f7-9a69-32419cbc2459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670cabde-e247-49bc-8652-e3486648ea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:37 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Volume 7bf87e5f-6f70-4d35-bd62-b09bf8f48b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04', 'volume_size': 1} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf87e5f-6f70-4d35-bd62-b09bf8f48b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b469dcda0f4b5b8289516476b626ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:37Z,use_quota=True,user_id='28bf981068ba4002821935f5351f35da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Creating volume 7bf87e5f-6f70-4d35-bd62-b09bf8f48b04 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:37 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:15:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:37 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04 1073741824 Nov 03 17:15:37 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:37 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04 1073741824" returned: 0 in 0.661s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:38 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04 Nov 03 17:15:38 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:38 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04" returned: 0 in 0.422s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670cabde-e247-49bc-8652-e3486648ea40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9659ce6c-5140-4fe9-b1a4-4c8c7e9ecdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:38 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Volume volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04 (7bf87e5f-6f70-4d35-bd62-b09bf8f48b04): created successfully Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9659ce6c-5140-4fe9-b1a4-4c8c7e9ecdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Flow 'volume_create_manager' (f41bb359-f4d0-41a5-bfea-aacc07deb094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:38 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f0c5a021-ab26-4841-be8d-8e727039af00 tempest-CinderUnicodeTest-1999841644 None] Created volume successfully. Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Flow 'volume_create_manager' (bf1a2208-5291-4287-b3ce-737382ae4233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0beb50-1f2e-4c11-97fc-688bb041072a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0beb50-1f2e-4c11-97fc-688bb041072a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db07688-0429-4ac1-ae0c-0e93e5916e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d672cec9840458282fab2910b723e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:39Z,use_quota=True,user_id='67fe7588bc0d4385b5b82a48f9d5cfa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c5c16e4-6b42-4e38-aeb5-eb798051cc54),volume_type_id=1c5c16e4-6b42-4e38-aeb5-eb798051cc54)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da016f22-ba52-40af-8212-abc246e5b328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da016f22-ba52-40af-8212-abc246e5b328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a655d43-2cb0-4336-8338-a5dd55cd18d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:38 devstack cinder-volume[86661]: DEBUG cinder.image.glance [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Creating Keystone auth plugin from conf {{(pid=86661) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:15:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a655d43-2cb0-4336-8338-a5dd55cd18d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0db07688-0429-4ac1-ae0c-0e93e5916e96', 'volume_name': 'volume-0db07688-0429-4ac1-ae0c-0e93e5916e96', 'volume_size': 1, 'image_id': 'd6209d16-4cde-499c-a58c-e62e460b16ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6209d16-4cde-499c-a58c-e62e460b16ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fdf7419740fe21954e46228c2cdb81c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d672cec9840458282fab2910b723e66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b5bbe73f9c307d0c903f73859d2c9966c3a3aa36b1d611a32e321069950bd019e78f355502c3e7c3bb2a8c234e8eea36b43c48913cf5660ec9bf8658916beda', 'id': 'd6209d16-4cde-499c-a58c-e62e460b16ab', 'created_at': datetime.datetime(2026, 11, 3, 16, 15, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 15, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6209d16-4cde-499c-a58c-e62e460b16ab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5747baa0-2095-4dae-9537-18f7445373b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5747baa0-2095-4dae-9537-18f7445373b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:39 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b451847-f9ad-4f34-89c8-3a1c6c185ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:39 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Volume 0db07688-0429-4ac1-ae0c-0e93e5916e96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0db07688-0429-4ac1-ae0c-0e93e5916e96', 'volume_size': 1, 'image_id': 'd6209d16-4cde-499c-a58c-e62e460b16ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6209d16-4cde-499c-a58c-e62e460b16ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fdf7419740fe21954e46228c2cdb81c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d672cec9840458282fab2910b723e66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b5bbe73f9c307d0c903f73859d2c9966c3a3aa36b1d611a32e321069950bd019e78f355502c3e7c3bb2a8c234e8eea36b43c48913cf5660ec9bf8658916beda', 'id': 'd6209d16-4cde-499c-a58c-e62e460b16ab', 'created_at': datetime.datetime(2026, 11, 3, 16, 15, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 15, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6209d16-4cde-499c-a58c-e62e460b16ab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 17:15:39 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Trying to clone 0db07688-0429-4ac1-ae0c-0e93e5916e96 from image d6209d16-4cde-499c-a58c-e62e460b16ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6209d16-4cde-499c-a58c-e62e460b16ab', 'metadata': {}}]). {{(pid=86661) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:15:39 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:15:39 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:15:39 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df506c1-5143-4ad4-9167-707181c464e9]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:39 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD Nov 03 17:15:39 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:40 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:40 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD Nov 03 17:15:40 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Flow 'volume_create_manager' (fb6dc143-94f5-4a2d-ae02-584369ba914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2a1ffd-8362-4ed4-90ae-d2ae8825277d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2a1ffd-8362-4ed4-90ae-d2ae8825277d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1974706021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743d615f-6041-4472-bc56-f5956e01e477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b469dcda0f4b5b8289516476b626ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:41Z,use_quota=True,user_id='28bf981068ba4002821935f5351f35da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:40 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4069158-5384-455c-9d7f-a0b66ba61d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4069158-5384-455c-9d7f-a0b66ba61d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6b55a3-ed15-4af7-8a47-805898ab0b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6b55a3-ed15-4af7-8a47-805898ab0b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743d615f-6041-4472-bc56-f5956e01e477', 'volume_name': 'volume-743d615f-6041-4472-bc56-f5956e01e477', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604e89cb-acbf-4f29-ac1f-6e843d80ccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604e89cb-acbf-4f29-ac1f-6e843d80ccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a475d2b2-50ef-4b00-ae01-c66d19d383be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:40 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Volume 743d615f-6041-4472-bc56-f5956e01e477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743d615f-6041-4472-bc56-f5956e01e477', 'volume_size': 1} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1974706021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743d615f-6041-4472-bc56-f5956e01e477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b469dcda0f4b5b8289516476b626ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:41Z,use_quota=True,user_id='28bf981068ba4002821935f5351f35da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Creating volume 743d615f-6041-4472-bc56-f5956e01e477 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:40 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD" returned: 1 in 0.603s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:15:40 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Temporary image d6209d16-4cde-499c-a58c-e62e460b16ab is fetched for user 67fe7588bc0d4385b5b82a48f9d5cfa8. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:15:40 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 1073741824 Nov 03 17:15:40 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:41 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f402808-ff08-44e7-8b2e-f71d34507610]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:41 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD Nov 03 17:15:41 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:41 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 1073741824" returned: 0 in 0.882s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:41 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 Nov 03 17:15:41 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:41 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD" returned: 0 in 0.712s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:42 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD Nov 03 17:15:42 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:42 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477" returned: 0 in 0.349s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a475d2b2-50ef-4b00-ae01-c66d19d383be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743d615f-6041-4472-bc56-f5956e01e477', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae69b300-7b79-4222-9fee-8eeedb8b8944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:42 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Volume volume-743d615f-6041-4472-bc56-f5956e01e477 (743d615f-6041-4472-bc56-f5956e01e477): created successfully Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae69b300-7b79-4222-9fee-8eeedb8b8944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Flow 'volume_create_manager' (fb6dc143-94f5-4a2d-ae02-584369ba914a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:42 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e00dfcc2-86bc-4f58-a59c-e649eb20acf1 tempest-CinderUnicodeTest-1999841644 None] Created volume successfully. Nov 03 17:15:42 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD" returned: 1 in 0.551s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db07688-0429-4ac1-ae0c-0e93e5916e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d672cec9840458282fab2910b723e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:39Z,use_quota=True,user_id='67fe7588bc0d4385b5b82a48f9d5cfa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c5c16e4-6b42-4e38-aeb5-eb798051cc54),volume_type_id=1c5c16e4-6b42-4e38-aeb5-eb798051cc54)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Creating volume 0db07688-0429-4ac1-ae0c-0e93e5916e96 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:42 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:15:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:42 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 1073741824 Nov 03 17:15:42 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:43 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 1073741824" returned: 0 in 0.843s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:43 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 Nov 03 17:15:43 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:43 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96" returned: 0 in 0.385s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.441s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] Creating offline snapshot 25680aae-8404-4a46-8c02-4775a0ea7ced of volume 743d615f-6041-4472-bc56-f5956e01e477 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Attempting download of d6209d16-4cde-499c-a58c-e62e460b16ab ((None, [{'url': 'file:///opt/stack/data/glance/images/d6209d16-4cde-499c-a58c-e62e460b16ab', 'metadata': {}}])) to volume 0db07688-0429-4ac1-ae0c-0e93e5916e96. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee119916-9cff-43c2-b785-bd9a96ab53e1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:43 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fa0f63-48cb-4f38-a550-5c1aae3a1a5f]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6209d16-4cde-499c-a58c-e62e460b16ab_4g5zvu7h {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:44 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 Nov 03 17:15:44 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:44 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6209d16-4cde-499c-a58c-e62e460b16ab_4g5zvu7h Nov 03 17:15:44 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:44 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6209d16-4cde-499c-a58c-e62e460b16ab_4g5zvu7h" returned: 0 in 0.592s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6209d16-4cde-499c-a58c-e62e460b16ab_4g5zvu7h {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:44 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477" returned: 0 in 0.933s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:44 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6209d16-4cde-499c-a58c-e62e460b16ab_4g5zvu7h Nov 03 17:15:44 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:44 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced 1G Nov 03 17:15:44 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:45 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6209d16-4cde-499c-a58c-e62e460b16ab_4g5zvu7h" returned: 1 in 0.647s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6209d16-4cde-499c-a58c-e62e460b16ab_4g5zvu7h' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:15:45 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb33b15-0c3c-4fa3-a65c-9d631b14c6dc]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:45 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD Nov 03 17:15:45 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:45 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced 1G" returned: 0 in 0.837s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743d615f-6041-4472-bc56-f5956e01e477 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:45 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743d615f-6041-4472-bc56-f5956e01e477 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced Nov 03 17:15:45 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:45 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD" returned: 0 in 0.548s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:45 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD Nov 03 17:15:45 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:46 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743d615f-6041-4472-bc56-f5956e01e477 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced" returned: 0 in 0.533s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:46 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced is being set with open permissions: ugo+rw Nov 03 17:15:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:46 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD" returned: 1 in 0.460s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:15:46 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] d6209d16-4cde-499c-a58c-e62e460b16ab was raw, converting to qcow2 {{(pid=86661) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:15:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:46 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 Nov 03 17:15:46 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:46 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced Nov 03 17:15:46 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:46 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced" returned: 0 in 0.561s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:46 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.info Nov 03 17:15:46 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:47 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96" returned: 0 in 0.880s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6209d16-4cde-499c-a58c-e62e460b16ab_0ly1l2c7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:15:47 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:47 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 1G Nov 03 17:15:47 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:47 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.info" returned: 0 in 0.452s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:47 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.info is being set with open permissions: ugo+rw Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:47 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.info Nov 03 17:15:47 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:47 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.info" returned: 0 in 0.421s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.929s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:47 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f2a55ed9-adc0-48f2-8641-bd3cd553b004 tempest-CinderUnicodeTest-1999841644 None] Create snapshot completed successfully Nov 03 17:15:47 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 1G" returned: 0 in 0.712s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Downloaded image d6209d16-4cde-499c-a58c-e62e460b16ab ((None, [{'url': 'file:///opt/stack/data/glance/images/d6209d16-4cde-499c-a58c-e62e460b16ab', 'metadata': {}}])) to volume 0db07688-0429-4ac1-ae0c-0e93e5916e96 successfully. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Temporary image d6209d16-4cde-499c-a58c-e62e460b16ab for user 67fe7588bc0d4385b5b82a48f9d5cfa8 is deleted. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Marking volume 0db07688-0429-4ac1-ae0c-0e93e5916e96 as bootable. {{(pid=86661) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Copying metadata from image d6209d16-4cde-499c-a58c-e62e460b16ab to 0db07688-0429-4ac1-ae0c-0e93e5916e96. {{(pid=86661) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:15:47 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Creating volume glance metadata for volume 0db07688-0429-4ac1-ae0c-0e93e5916e96 backed by image d6209d16-4cde-499c-a58c-e62e460b16ab with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd6209d16-4cde-499c-a58c-e62e460b16ab', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3fdf7419740fe21954e46228c2cdb81c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86661) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:15:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b451847-f9ad-4f34-89c8-3a1c6c185ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db07688-0429-4ac1-ae0c-0e93e5916e96', 'volume_size': 1, 'image_id': 'd6209d16-4cde-499c-a58c-e62e460b16ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6209d16-4cde-499c-a58c-e62e460b16ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3fdf7419740fe21954e46228c2cdb81c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d672cec9840458282fab2910b723e66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b5bbe73f9c307d0c903f73859d2c9966c3a3aa36b1d611a32e321069950bd019e78f355502c3e7c3bb2a8c234e8eea36b43c48913cf5660ec9bf8658916beda', 'id': 'd6209d16-4cde-499c-a58c-e62e460b16ab', 'created_at': datetime.datetime(2026, 11, 3, 16, 15, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 15, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6209d16-4cde-499c-a58c-e62e460b16ab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c61dc4-15fb-4211-8dc1-92b9c14ea072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:48 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Volume volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 (0db07688-0429-4ac1-ae0c-0e93e5916e96): created successfully Nov 03 17:15:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c61dc4-15fb-4211-8dc1-92b9c14ea072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Flow 'volume_create_manager' (bf1a2208-5291-4287-b3ce-737382ae4233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-59741741-24ba-49c7-a9d3-f43c725826c3 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Created volume successfully. Nov 03 17:15:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Acquiring lock "cinder-0db07688-0429-4ac1-ae0c-0e93e5916e96-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "cinder-25680aae-8404-4a46-8c02-4775a0ea7ced-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Lock "cinder-0db07688-0429-4ac1-ae0c-0e93e5916e96-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-25680aae-8404-4a46-8c02-4775a0ea7ced-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "cinder-quobyte-743d615f-6041-4472-bc56-f5956e01e477" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-quobyte-743d615f-6041-4472-bc56-f5956e01e477" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "cinder-quobyte-25680aae-8404-4a46-8c02-4775a0ea7ced" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Acquiring lock "cinder-quobyte-0db07688-0429-4ac1-ae0c-0e93e5916e96" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-quobyte-25680aae-8404-4a46-8c02-4775a0ea7ced" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Deleting offline snapshot 25680aae-8404-4a46-8c02-4775a0ea7ced of volume 743d615f-6041-4472-bc56-f5956e01e477 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] snapshot_file for this snap is: volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6a71e3-3cd9-4911-8b49-e1307d95d6a7]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Lock "cinder-quobyte-0db07688-0429-4ac1-ae0c-0e93e5916e96" acquired by "delete_volume" :: waited 0.091s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cf6333-22f8-4042-8c48-e1945797770f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:49 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced Nov 03 17:15:49 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:49 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 Nov 03 17:15:49 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:49 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced" returned: 0 in 0.654s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-743d615f-6041-4472-bc56-f5956e01e477(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bab95d-fd4e-42fc-9f0b-cfc848dec0e1]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:49 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96" returned: 0 in 0.766s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:50 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96 Nov 03 17:15:50 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:50 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 Nov 03 17:15:50 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:50 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0db07688-0429-4ac1-ae0c-0e93e5916e96" returned: 0 in 0.396s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Lock "cinder-quobyte-0db07688-0429-4ac1-ae0c-0e93e5916e96" released by "delete_volume" :: held 1.236s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:50 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477" returned: 0 in 0.570s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:50 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced Nov 03 17:15:50 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:50 devstack cinder-volume[86661]: WARNING cinder.quota [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:15:50 devstack cinder-volume[86661]: WARNING cinder.quota [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Created reservations ['0fa23bf4-3bd4-4b39-b8d8-634d97370d1b', '76d82169-92f7-4135-99cf-952001075017', 'fd8042c3-47f3-437e-b68d-8f41da9108f3', 'd167c3bc-0e2a-4986-908e-c1390cb086bf'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:50 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:15:50 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:50 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced" returned: 0 in 0.378s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:50 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced Nov 03 17:15:50 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:50 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.332s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:50 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:50 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Deleted volume successfully. Nov 03 17:15:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-70e380f2-3673-4057-b27a-32cef6210a92 tempest-VolumeAndVolumeTypeFromImageTest-1507760127 None] Lock "cinder-0db07688-0429-4ac1-ae0c-0e93e5916e96-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:51 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477.25680aae-8404-4a46-8c02-4775a0ea7ced" returned: 0 in 0.418s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-quobyte-25680aae-8404-4a46-8c02-4775a0ea7ced" released by "_delete_snapshot" :: held 2.205s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-quobyte-743d615f-6041-4472-bc56-f5956e01e477" released by "delete_snapshot" :: held 2.255s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:51 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Created reservations ['c1234eb5-43d2-4f34-83d4-3ce4a45a7faf', '1353b3e2-8007-41ea-aec0-a7e3c8c27d13', 'cc18655a-6f26-4a1d-9b0e-cf61360a6ea3', '70893ef4-2e29-40aa-959a-0ed30cc42591'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:51 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Delete snapshot completed successfully. Nov 03 17:15:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a7150ebc-4bd1-46af-8433-7404ae827b55 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-25680aae-8404-4a46-8c02-4775a0ea7ced-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "cinder-743d615f-6041-4472-bc56-f5956e01e477-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-743d615f-6041-4472-bc56-f5956e01e477-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "cinder-quobyte-743d615f-6041-4472-bc56-f5956e01e477" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-quobyte-743d615f-6041-4472-bc56-f5956e01e477" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:52 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d19f98-5ba7-42a0-8f13-c8c37d9f3b1d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:52 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 Nov 03 17:15:52 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:53 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477" returned: 0 in 0.568s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:53 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477 Nov 03 17:15:53 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:53 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-743d615f-6041-4472-bc56-f5956e01e477" returned: 0 in 0.318s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-quobyte-743d615f-6041-4472-bc56-f5956e01e477" released by "delete_volume" :: held 0.971s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:53 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Created reservations ['72374b8c-00cf-44fe-a5e5-71f6df9091cb', '16e41068-6b56-46f8-9862-9297bed043a9', '3bc6cca4-c19f-4241-9a7e-fbdac77eebbb', 'fdef2872-0a71-4fdf-ba26-50d3ca44eb19'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:53 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:15:53 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:54 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.389s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:54 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:54 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Deleted volume successfully. Nov 03 17:15:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-10087802-ce72-497c-a9f0-9934c70db208 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-743d615f-6041-4472-bc56-f5956e01e477-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "cinder-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "cinder-quobyte-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:15:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-quobyte-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:15:54 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6673a6-5065-4587-963a-12e828ec2d2f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:15:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:55 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04 Nov 03 17:15:55 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:55 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04" returned: 0 in 0.493s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:55 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04 Nov 03 17:15:55 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:55 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04" returned: 0 in 0.288s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-quobyte-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04" released by "delete_volume" :: held 0.848s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:55 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Created reservations ['ef6de0a4-b405-43df-a59d-716f3fa94670', '4b0e5e41-deb7-414b-a45f-3522a1a6868f', '4bd02d84-a53f-450c-8967-e1fee739d5a6', '68872237-573d-42e6-b300-84c553ee52f1'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:15:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:55 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:55 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:15:55 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:56 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.403s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:56 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:15:56 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Deleted volume successfully. Nov 03 17:15:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3b5e3953-cd06-4836-be6e-5a4194de0e30 tempest-CinderUnicodeTest-1999841644 None] Lock "cinder-7bf87e5f-6f70-4d35-bd62-b09bf8f48b04-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Flow 'volume_create_manager' (4a78bad1-dd97-4980-bf61-f5e5aa449c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96ae579-af53-4ac4-84d6-e77429649870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96ae579-af53-4ac4-84d6-e77429649870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1731463070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de1ddf7-fa3b-40b2-ae67-f176cca5da73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e1d16ecc348d5a10a331d1eacf29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:58Z,use_quota=True,user_id='49484ead55c144df9e57c29e73429e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ca4045-beed-4081-80b2-dbca89c3d065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ca4045-beed-4081-80b2-dbca89c3d065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74132c7-f80b-47ad-b071-2d36eddf8589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74132c7-f80b-47ad-b071-2d36eddf8589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8de1ddf7-fa3b-40b2-ae67-f176cca5da73', 'volume_name': 'volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac0445b-8b5f-4cb4-af47-544ea730d4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac0445b-8b5f-4cb4-af47-544ea730d4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97be7800-84f3-4320-80fc-090df4fc7269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:58 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Volume 8de1ddf7-fa3b-40b2-ae67-f176cca5da73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73', 'volume_size': 1} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1731463070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de1ddf7-fa3b-40b2-ae67-f176cca5da73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e1d16ecc348d5a10a331d1eacf29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:58Z,use_quota=True,user_id='49484ead55c144df9e57c29e73429e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Creating volume 8de1ddf7-fa3b-40b2-ae67-f176cca5da73 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:58 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:58 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73 1073741824 Nov 03 17:15:58 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Flow 'volume_create_manager' (1354867a-bd48-4729-891d-02ee90d513ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c5ef92-195b-4d17-abd3-5b1b1a4c8bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c5ef92-195b-4d17-abd3-5b1b1a4c8bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-10520667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96337919-c381-4342-ab17-cae2aa81f42e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e1d16ecc348d5a10a331d1eacf29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:59Z,use_quota=True,user_id='49484ead55c144df9e57c29e73429e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d389e06-da8b-4d4e-9c24-8ad6630cadcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d389e06-da8b-4d4e-9c24-8ad6630cadcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57e233f-cefc-4808-bc8f-31e95609730e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57e233f-cefc-4808-bc8f-31e95609730e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96337919-c381-4342-ab17-cae2aa81f42e', 'volume_name': 'volume-96337919-c381-4342-ab17-cae2aa81f42e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735990ce-0423-41c7-92c9-81d60a090aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735990ce-0423-41c7-92c9-81d60a090aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c9030a-16c2-4c72-aadd-dd6a947b7b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Volume 96337919-c381-4342-ab17-cae2aa81f42e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96337919-c381-4342-ab17-cae2aa81f42e', 'volume_size': 1} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:59 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73 1073741824" returned: 0 in 0.604s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:59 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73 Nov 03 17:15:59 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:59 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73" returned: 0 in 0.522s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.618s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-10520667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96337919-c381-4342-ab17-cae2aa81f42e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e1d16ecc348d5a10a331d1eacf29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:15:59Z,use_quota=True,user_id='49484ead55c144df9e57c29e73429e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Creating volume 96337919-c381-4342-ab17-cae2aa81f42e {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:15:59 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:15:59 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e 1073741824 Nov 03 17:15:59 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97be7800-84f3-4320-80fc-090df4fc7269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b3a5d0-df77-4221-a6b0-810a542d7d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Flow 'volume_create_manager' (da724cd3-aa9a-42de-8b09-2b9af3d57198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955ce2ef-2d07-4118-9e5b-0c1fc57f3e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Volume volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73 (8de1ddf7-fa3b-40b2-ae67-f176cca5da73): created successfully Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b3a5d0-df77-4221-a6b0-810a542d7d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Flow 'volume_create_manager' (4a78bad1-dd97-4980-bf61-f5e5aa449c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955ce2ef-2d07-4118-9e5b-0c1fc57f3e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981509437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371c71ea-3acc-425c-a7b9-6f89d2b4efa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e1d16ecc348d5a10a331d1eacf29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:00Z,use_quota=True,user_id='49484ead55c144df9e57c29e73429e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8896d84-3f0a-472c-afa7-85c197450525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8896d84-3f0a-472c-afa7-85c197450525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7b6add-781e-4bf3-92ff-9b5c738bf182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7b6add-781e-4bf3-92ff-9b5c738bf182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371c71ea-3acc-425c-a7b9-6f89d2b4efa3', 'volume_name': 'volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d876e2-f488-4f94-8342-6143f08da56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d876e2-f488-4f94-8342-6143f08da56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ccaf06-1702-4899-98a5-264efd58d1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:15:59 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Volume 371c71ea-3acc-425c-a7b9-6f89d2b4efa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3', 'volume_size': 1} Nov 03 17:15:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:15:59 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-81c42996-c421-4940-a148-85118f91c122 tempest-CreateVolumesFromImageTest-715079102 None] Created volume successfully. Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Flow 'volume_create_manager' (450a6337-9381-4d26-8808-5f633d2e9677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc50eaa8-0d04-4266-b0bf-5717e5755da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:00 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e 1073741824" returned: 0 in 0.601s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc50eaa8-0d04-4266-b0bf-5717e5755da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1979165238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96f90a2-528f-48fb-8258-dd8eb0dababc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e1d16ecc348d5a10a331d1eacf29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:00Z,use_quota=True,user_id='49484ead55c144df9e57c29e73429e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a31449-6cd3-4673-a39a-94549ca41eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a31449-6cd3-4673-a39a-94549ca41eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95df5d4f-8837-44c5-acf9-276de055e9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95df5d4f-8837-44c5-acf9-276de055e9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e96f90a2-528f-48fb-8258-dd8eb0dababc', 'volume_name': 'volume-e96f90a2-528f-48fb-8258-dd8eb0dababc', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee3bd67-e6b4-428a-b367-01c34f147ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee3bd67-e6b4-428a-b367-01c34f147ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a5b00d-dd1b-48d7-af1a-cf38806cb4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:00 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Volume e96f90a2-528f-48fb-8258-dd8eb0dababc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e96f90a2-528f-48fb-8258-dd8eb0dababc', 'volume_size': 1} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:00 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e Nov 03 17:16:00 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:00 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e" returned: 0 in 0.329s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981509437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371c71ea-3acc-425c-a7b9-6f89d2b4efa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e1d16ecc348d5a10a331d1eacf29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:00Z,use_quota=True,user_id='49484ead55c144df9e57c29e73429e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Creating volume 371c71ea-3acc-425c-a7b9-6f89d2b4efa3 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:00 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:00 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3 1073741824 Nov 03 17:16:00 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c9030a-16c2-4c72-aadd-dd6a947b7b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96337919-c381-4342-ab17-cae2aa81f42e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df9fee0-9f18-4a2f-9a2c-5a8fdad06410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:00 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Volume volume-96337919-c381-4342-ab17-cae2aa81f42e (96337919-c381-4342-ab17-cae2aa81f42e): created successfully Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df9fee0-9f18-4a2f-9a2c-5a8fdad06410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Flow 'volume_create_manager' (1354867a-bd48-4729-891d-02ee90d513ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:00 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f7e8f84d-03a3-402b-9ed3-136920bc70e7 tempest-CreateVolumesFromImageTest-715079102 None] Created volume successfully. Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Flow 'volume_create_manager' (5ea5d046-17e2-48a5-af78-2b42e275052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8478475c-5f7f-4347-825e-e9efc7dece41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8478475c-5f7f-4347-825e-e9efc7dece41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1876307934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8730c07f-37cf-4551-b22b-2c868f32bf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e1d16ecc348d5a10a331d1eacf29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:01Z,use_quota=True,user_id='49484ead55c144df9e57c29e73429e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bedfd3-206b-4966-ade4-0d0f280f08f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bedfd3-206b-4966-ade4-0d0f280f08f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba0e890-951a-405d-90a9-644fc7b08e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba0e890-951a-405d-90a9-644fc7b08e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8730c07f-37cf-4551-b22b-2c868f32bf50', 'volume_name': 'volume-8730c07f-37cf-4551-b22b-2c868f32bf50', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5a6b83-1087-4c5c-97c1-a5b3c9c7f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5a6b83-1087-4c5c-97c1-a5b3c9c7f923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b80895-09bb-4633-825d-b5c8aa149aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Volume 8730c07f-37cf-4551-b22b-2c868f32bf50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8730c07f-37cf-4551-b22b-2c868f32bf50', 'volume_size': 1} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:01 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3 1073741824" returned: 0 in 0.609s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:01 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3 Nov 03 17:16:01 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Flow 'volume_create_manager' (302d476c-575a-45a9-8ca6-60999aa28449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63af64e8-81a1-4f6d-8642-b425e77b5c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63af64e8-81a1-4f6d-8642-b425e77b5c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944709502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13011576-6a37-4e3f-be42-04badbb86da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d030bbed9074bdba25078c8d0c7792a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:02Z,use_quota=True,user_id='3bedd5a759734654bd3d4396bce69b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8318c704-d639-46b5-b9d8-ca3e768c93b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8318c704-d639-46b5-b9d8-ca3e768c93b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2464212b-f29b-4aba-a0f2-8ea10c5f7d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2464212b-f29b-4aba-a0f2-8ea10c5f7d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13011576-6a37-4e3f-be42-04badbb86da9', 'volume_name': 'volume-13011576-6a37-4e3f-be42-04badbb86da9', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a8b3ec-3ee8-4928-8667-b6b8ba76a3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a8b3ec-3ee8-4928-8667-b6b8ba76a3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef407a3d-4de6-4f27-a539-979914c9fa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Volume 13011576-6a37-4e3f-be42-04badbb86da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13011576-6a37-4e3f-be42-04badbb86da9', 'volume_size': 1} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3" returned: 0 in 0.456s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1979165238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96f90a2-528f-48fb-8258-dd8eb0dababc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e1d16ecc348d5a10a331d1eacf29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:00Z,use_quota=True,user_id='49484ead55c144df9e57c29e73429e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Creating volume e96f90a2-528f-48fb-8258-dd8eb0dababc {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:01 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ccaf06-1702-4899-98a5-264efd58d1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:01 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc 1073741824 Nov 03 17:16:01 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8be8dc-cb00-40f2-a9e6-a6015ce5302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:01 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Volume volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3 (371c71ea-3acc-425c-a7b9-6f89d2b4efa3): created successfully Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8be8dc-cb00-40f2-a9e6-a6015ce5302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Flow 'volume_create_manager' (da724cd3-aa9a-42de-8b09-2b9af3d57198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-26eb61ec-f990-4ac3-963b-32ba8bc471ee tempest-CreateVolumesFromImageTest-715079102 None] Created volume successfully. Nov 03 17:16:02 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc 1073741824" returned: 0 in 0.681s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:02 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc Nov 03 17:16:02 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:02 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc" returned: 0 in 0.313s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.959s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1876307934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8730c07f-37cf-4551-b22b-2c868f32bf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e1d16ecc348d5a10a331d1eacf29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:01Z,use_quota=True,user_id='49484ead55c144df9e57c29e73429e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Creating volume 8730c07f-37cf-4551-b22b-2c868f32bf50 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:03 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:16:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a5b00d-dd1b-48d7-af1a-cf38806cb4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96f90a2-528f-48fb-8258-dd8eb0dababc', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a4a8c5-dc0a-48e1-bbfb-ebbef63f60d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:03 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50 1073741824 Nov 03 17:16:03 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:03 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Volume volume-e96f90a2-528f-48fb-8258-dd8eb0dababc (e96f90a2-528f-48fb-8258-dd8eb0dababc): created successfully Nov 03 17:16:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a4a8c5-dc0a-48e1-bbfb-ebbef63f60d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Flow 'volume_create_manager' (450a6337-9381-4d26-8808-5f633d2e9677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:03 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-39aefb1b-1c8e-4660-bd2c-98d3e5712060 tempest-CreateVolumesFromImageTest-715079102 None] Created volume successfully. Nov 03 17:16:03 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50 1073741824" returned: 0 in 0.825s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:03 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50 Nov 03 17:16:03 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:04 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50" returned: 0 in 0.299s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.291s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-944709502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13011576-6a37-4e3f-be42-04badbb86da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d030bbed9074bdba25078c8d0c7792a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:02Z,use_quota=True,user_id='3bedd5a759734654bd3d4396bce69b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Creating volume 13011576-6a37-4e3f-be42-04badbb86da9 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:04 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b80895-09bb-4633-825d-b5c8aa149aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8730c07f-37cf-4551-b22b-2c868f32bf50', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c490cf2-c8f3-49d8-bf14-7905b7aae802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:04 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9 1073741824 Nov 03 17:16:04 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:04 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Volume volume-8730c07f-37cf-4551-b22b-2c868f32bf50 (8730c07f-37cf-4551-b22b-2c868f32bf50): created successfully Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c490cf2-c8f3-49d8-bf14-7905b7aae802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Flow 'volume_create_manager' (5ea5d046-17e2-48a5-af78-2b42e275052b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b37e7594-f2ce-4eec-80f4-35ae9d66fde3 tempest-CreateVolumesFromImageTest-715079102 None] Created volume successfully. Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "cinder-8730c07f-37cf-4551-b22b-2c868f32bf50-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-8730c07f-37cf-4551-b22b-2c868f32bf50-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "cinder-quobyte-8730c07f-37cf-4551-b22b-2c868f32bf50" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-quobyte-8730c07f-37cf-4551-b22b-2c868f32bf50" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[760dc412-cbb9-44c9-8f03-98bdbbb307f4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:04 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9 1073741824" returned: 0 in 0.719s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:04 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50 Nov 03 17:16:04 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:04 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9 Nov 03 17:16:04 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:05 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9" returned: 0 in 0.292s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef407a3d-4de6-4f27-a539-979914c9fa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13011576-6a37-4e3f-be42-04badbb86da9', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5927abbc-24c4-4d78-a98d-f726686389a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:05 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Volume volume-13011576-6a37-4e3f-be42-04badbb86da9 (13011576-6a37-4e3f-be42-04badbb86da9): created successfully Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5927abbc-24c4-4d78-a98d-f726686389a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Flow 'volume_create_manager' (302d476c-575a-45a9-8ca6-60999aa28449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:05 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50" returned: 0 in 0.480s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:05 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-da24a957-1ad3-4dd3-bf09-f00e22e8106c tempest-ProjectReaderTests-1049520604 None] Created volume successfully. Nov 03 17:16:05 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50 Nov 03 17:16:05 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:05 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8730c07f-37cf-4551-b22b-2c868f32bf50" returned: 0 in 0.295s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-quobyte-8730c07f-37cf-4551-b22b-2c868f32bf50" released by "delete_volume" :: held 0.863s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Created reservations ['f89792c5-e06f-43a8-875c-5fef72d81770', 'ea000ab7-3b06-4d05-97aa-89c81612ced3', 'd456b056-fdc0-4a7a-bb1a-95cbffa178d2', '144111d6-0214-459a-95e8-ad70bd1e7304'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:05 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:05 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "cinder-e96f90a2-528f-48fb-8258-dd8eb0dababc-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-e96f90a2-528f-48fb-8258-dd8eb0dababc-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "cinder-quobyte-e96f90a2-528f-48fb-8258-dd8eb0dababc" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-quobyte-e96f90a2-528f-48fb-8258-dd8eb0dababc" acquired by "delete_volume" :: waited 0.033s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2fac17-6730-4b79-9204-ff95b1c42b48]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:06 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.551s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:06 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Deleted volume successfully. Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a818b19d-4891-462a-90eb-dff4e92664ea tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-8730c07f-37cf-4551-b22b-2c868f32bf50-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Acquiring lock "cinder-13011576-6a37-4e3f-be42-04badbb86da9-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:06 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc Nov 03 17:16:06 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Lock "cinder-13011576-6a37-4e3f-be42-04badbb86da9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Acquiring lock "cinder-quobyte-13011576-6a37-4e3f-be42-04badbb86da9" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Lock "cinder-quobyte-13011576-6a37-4e3f-be42-04badbb86da9" acquired by "delete_volume" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db25faf-be10-4e97-9f9f-d9b5999ac005]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:06 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9 Nov 03 17:16:06 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:06 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc" returned: 0 in 0.521s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:06 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc Nov 03 17:16:06 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:07 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9" returned: 0 in 0.452s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:07 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9 Nov 03 17:16:07 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:07 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e96f90a2-528f-48fb-8258-dd8eb0dababc" returned: 0 in 0.319s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-quobyte-e96f90a2-528f-48fb-8258-dd8eb0dababc" released by "delete_volume" :: held 0.949s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Created reservations ['7f2d8e0a-c682-406f-add6-c57951cac661', 'f2521cfe-ec69-4295-84e3-0ef077ffe708', 'df8a8bfc-1d3d-42a1-9d51-5456285145a1', 'f173a76a-955a-4ac5-a046-0d48d4e88a88'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:07 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:07 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:07 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-13011576-6a37-4e3f-be42-04badbb86da9" returned: 0 in 0.320s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "cinder-371c71ea-3acc-425c-a7b9-6f89d2b4efa3-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Lock "cinder-quobyte-13011576-6a37-4e3f-be42-04badbb86da9" released by "delete_volume" :: held 0.851s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-371c71ea-3acc-425c-a7b9-6f89d2b4efa3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "cinder-quobyte-371c71ea-3acc-425c-a7b9-6f89d2b4efa3" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Created reservations ['789c77a4-1cd1-48e2-ba7f-8bc2c74b3b62', '6ead3a0a-20f8-4b6c-b98a-3e0cd25603fd', '9f9254cd-5ef2-41d4-961f-623de1c19035', '25103988-bc0f-4523-a01a-b16c4d37efd7'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-quobyte-371c71ea-3acc-425c-a7b9-6f89d2b4efa3" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c54223-a049-46ea-9753-09c213e304a2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:07 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:07 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:07 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3 Nov 03 17:16:07 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:07 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.473s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:07 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Deleted volume successfully. Nov 03 17:16:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bd5bc3cf-bdef-4229-8daf-2868a76849fb tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-e96f90a2-528f-48fb-8258-dd8eb0dababc-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:08 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.303s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:08 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Deleted volume successfully. Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-69017f93-ec5d-451b-bd03-866918454132 tempest-ProjectReaderTests-1049520604 None] Lock "cinder-13011576-6a37-4e3f-be42-04badbb86da9-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:08 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3" returned: 0 in 0.565s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:08 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3 Nov 03 17:16:08 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:08 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-371c71ea-3acc-425c-a7b9-6f89d2b4efa3" returned: 0 in 0.391s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-quobyte-371c71ea-3acc-425c-a7b9-6f89d2b4efa3" released by "delete_volume" :: held 1.042s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Flow 'volume_create_manager' (86bf16b7-ab19-4010-83e2-d9c212f66dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c78b9c-9aa7-4957-a602-25f0d1e8957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c78b9c-9aa7-4957-a602-25f0d1e8957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754905666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51eea9bf-b5a6-49e3-a856-026f0a8df19a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d030bbed9074bdba25078c8d0c7792a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:09Z,use_quota=True,user_id='3bedd5a759734654bd3d4396bce69b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300ce0d7-3b54-4f19-a5cd-8c3ca0d4e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300ce0d7-3b54-4f19-a5cd-8c3ca0d4e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa006922-4182-481e-9376-4c2bda6b6a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa006922-4182-481e-9376-4c2bda6b6a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51eea9bf-b5a6-49e3-a856-026f0a8df19a', 'volume_name': 'volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b67d7ff-9150-47b0-b01b-ab56e32af30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b67d7ff-9150-47b0-b01b-ab56e32af30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadb4176-a4f2-4a46-8ffc-22decef24b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:08 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Volume 51eea9bf-b5a6-49e3-a856-026f0a8df19a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a', 'volume_size': 1} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754905666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51eea9bf-b5a6-49e3-a856-026f0a8df19a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d030bbed9074bdba25078c8d0c7792a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:09Z,use_quota=True,user_id='3bedd5a759734654bd3d4396bce69b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Creating volume 51eea9bf-b5a6-49e3-a856-026f0a8df19a {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:08 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:08 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a 1073741824 Nov 03 17:16:08 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Created reservations ['ae2bddcb-f89c-40ca-9c58-7bd4bac0b855', '4c03b004-1a6f-442b-a5db-3eca9a17c196', 'ac299ed6-5600-4d5d-94ca-17c6eee31d35', 'ac0f1a66-58cb-4552-8a57-b6695241a20c'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:08 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:08 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:09 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.382s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Deleted volume successfully. Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-72649cd3-eecf-4610-bf8e-e78daf1589c3 tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-371c71ea-3acc-425c-a7b9-6f89d2b4efa3-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-99d05f19-f31c-437c-96e0-754c0145f868 req-514f25ea-9e96-4ddf-a1a5-cfcfb904bdd0 tempest-TestStampPattern-1336895651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:09 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a 1073741824" returned: 0 in 0.658s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:09 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a Nov 03 17:16:09 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:09 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "cinder-96337919-c381-4342-ab17-cae2aa81f42e-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a" returned: 0 in 0.303s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-99d05f19-f31c-437c-96e0-754c0145f868 req-514f25ea-9e96-4ddf-a1a5-cfcfb904bdd0 tempest-TestStampPattern-1336895651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.395s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-96337919-c381-4342-ab17-cae2aa81f42e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadb4176-a4f2-4a46-8ffc-22decef24b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729dea22-6979-4cc0-842a-32fe9afa19cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-99d05f19-f31c-437c-96e0-754c0145f868 req-514f25ea-9e96-4ddf-a1a5-cfcfb904bdd0 tempest-TestStampPattern-1336895651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:09 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Volume volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a (51eea9bf-b5a6-49e3-a856-026f0a8df19a): created successfully Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729dea22-6979-4cc0-842a-32fe9afa19cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Flow 'volume_create_manager' (86bf16b7-ab19-4010-83e2-d9c212f66dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-57226a4f-7d82-4b9e-aff9-eeea80cb4c4d tempest-ProjectReaderTests-1049520604 None] Created volume successfully. Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "cinder-quobyte-96337919-c381-4342-ab17-cae2aa81f42e" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-99d05f19-f31c-437c-96e0-754c0145f868 req-514f25ea-9e96-4ddf-a1a5-cfcfb904bdd0 tempest-TestStampPattern-1336895651 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d052328-bbe6-471f-b915-fb80ff1d796e', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-quobyte-96337919-c381-4342-ab17-cae2aa81f42e" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d99347e-dd8d-4aa5-8335-d057782c510e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-99d05f19-f31c-437c-96e0-754c0145f868 req-514f25ea-9e96-4ddf-a1a5-cfcfb904bdd0 tempest-TestStampPattern-1336895651 None] attachment_update completed successfully. Nov 03 17:16:10 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e Nov 03 17:16:10 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:10 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e" returned: 0 in 0.463s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:10 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e Nov 03 17:16:10 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:10 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Acquiring lock "cinder-51eea9bf-b5a6-49e3-a856-026f0a8df19a-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-96337919-c381-4342-ab17-cae2aa81f42e" returned: 0 in 0.454s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Lock "cinder-51eea9bf-b5a6-49e3-a856-026f0a8df19a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-quobyte-96337919-c381-4342-ab17-cae2aa81f42e" released by "delete_volume" :: held 1.017s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Acquiring lock "cinder-quobyte-51eea9bf-b5a6-49e3-a856-026f0a8df19a" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Lock "cinder-quobyte-51eea9bf-b5a6-49e3-a856-026f0a8df19a" acquired by "delete_volume" :: waited 0.027s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f52187-0676-4794-ab1f-1a8cbcd6f783]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Created reservations ['b098796d-e840-438e-b92f-ba3b6b322cb5', '3eb3c538-cec0-4161-a372-39407fcd47e8', 'e85b71ab-bf3e-485c-a674-a1249948d511', 'cf33dd74-fc5f-441a-be86-3193ecd941b6'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:11 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a Nov 03 17:16:11 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:11 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:11 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:11 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a" returned: 0 in 0.439s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:11 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a Nov 03 17:16:11 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:11 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.305s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:11 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Deleted volume successfully. Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-31febba4-604b-451d-8895-e67684e6720c tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-96337919-c381-4342-ab17-cae2aa81f42e-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:11 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-51eea9bf-b5a6-49e3-a856-026f0a8df19a" returned: 0 in 0.290s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Lock "cinder-quobyte-51eea9bf-b5a6-49e3-a856-026f0a8df19a" released by "delete_volume" :: held 0.773s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Created reservations ['20fa0b63-0537-48d4-b419-9cc5eb8d996d', 'c66546a6-e2aa-4ee0-a780-aab99df26c26', '80389490-be3e-465a-bf96-f91a1c6e6fd6', '4f8b5775-02bc-48d7-88f9-de556e9e34c3'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Flow 'volume_create_manager' (5a293459-b7c6-4b6e-990d-7e6580ee21ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9284d441-19e1-4c1d-8f52-cbc551158891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9284d441-19e1-4c1d-8f52-cbc551158891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1149708285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654867ce-4002-4288-a2e7-687b96b09efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec3c5c8ef149f9938b47c85975447f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:12Z,use_quota=True,user_id='85002aa83d574667bf4c275ddf630657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c26266-3bf2-4078-ac87-2962a6c392bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c26266-3bf2-4078-ac87-2962a6c392bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f562bd1-7c28-4cef-a6dc-1fdd9a972094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.image.glance [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Creating Keystone auth plugin from conf {{(pid=86661) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:11 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:11 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "cinder-8de1ddf7-fa3b-40b2-ae67-f176cca5da73-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-8de1ddf7-fa3b-40b2-ae67-f176cca5da73-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "cinder-quobyte-8de1ddf7-fa3b-40b2-ae67-f176cca5da73" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-quobyte-8de1ddf7-fa3b-40b2-ae67-f176cca5da73" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c568a71-561a-4b35-b507-59de05fe31db]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:12 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:12 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73 Nov 03 17:16:12 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f562bd1-7c28-4cef-a6dc-1fdd9a972094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '654867ce-4002-4288-a2e7-687b96b09efe', 'volume_name': 'volume-654867ce-4002-4288-a2e7-687b96b09efe', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fdf555-924f-483a-bb99-ff4b7151cc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85fdf555-924f-483a-bb99-ff4b7151cc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb383d1-b859-455b-8cf4-7f07c5ad41f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:12 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Volume 654867ce-4002-4288-a2e7-687b96b09efe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-654867ce-4002-4288-a2e7-687b96b09efe', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Trying to clone 654867ce-4002-4288-a2e7-687b96b09efe from image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]). {{(pid=86661) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.458s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:12 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Deleted volume successfully. Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-dc54eedc-5cff-4bde-8270-f20e02b7981b tempest-ProjectReaderTests-1049520604 None] Lock "cinder-51eea9bf-b5a6-49e3-a856-026f0a8df19a-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:12 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73" returned: 0 in 0.647s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:12 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73 Nov 03 17:16:12 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:12 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:16:12 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Image download 20.69 MB at 20.69 MB/s Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79f1a50-54c4-4383-ae8b-ac2f2e8f1a4e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:13 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD Nov 03 17:16:13 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:13 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-8de1ddf7-fa3b-40b2-ae67-f176cca5da73" returned: 0 in 0.416s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-quobyte-8de1ddf7-fa3b-40b2-ae67-f176cca5da73" released by "delete_volume" :: held 1.125s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Created reservations ['f60f6854-efdd-4d55-934c-f5469f5ad8c3', '543f18da-6a8f-4fc5-95cd-37db3b4e88f4', 'c45ff196-ee8f-4fa9-8a70-acba222e4927', '3fdac8c8-6ebb-4044-b6f2-ee739883386c'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:13 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:13 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:13 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD" returned: 0 in 0.595s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Temporary image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 is fetched for user 85002aa83d574667bf4c275ddf630657. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:16:13 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.344s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aa64e9-fd75-4c48-b4d2-2f39842e53af]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:13 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Deleted volume successfully. Nov 03 17:16:13 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-df5414c8-51d0-4732-9280-d256dab2757b tempest-CreateVolumesFromImageTest-715079102 None] Lock "cinder-8de1ddf7-fa3b-40b2-ae67-f176cca5da73-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:14 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD Nov 03 17:16:14 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:14 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1149708285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654867ce-4002-4288-a2e7-687b96b09efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec3c5c8ef149f9938b47c85975447f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:12Z,use_quota=True,user_id='85002aa83d574667bf4c275ddf630657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Creating volume 654867ce-4002-4288-a2e7-687b96b09efe {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:14 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:16:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:14 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe 1073741824 Nov 03 17:16:14 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:15 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe 1073741824" returned: 0 in 0.619s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:15 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe Nov 03 17:16:15 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:15 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe" returned: 0 in 0.371s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:15 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Attempting download of 4d6008ab-d7f4-4403-8d44-c7c2165d2356 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}])) to volume 654867ce-4002-4288-a2e7-687b96b09efe. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:16:15 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[af38bea5-5070-47fc-b9df-df87d8dbf112]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_2w1_pkys {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:15 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_2w1_pkys Nov 03 17:16:15 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:16 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_2w1_pkys" returned: 0 in 0.485s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_2w1_pkys {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:16 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_2w1_pkys Nov 03 17:16:16 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:16 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_2w1_pkys" returned: 1 in 0.487s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d6008ab-d7f4-4403-8d44-c7c2165d2356_2w1_pkys' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:16:16 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e49353-1721-40b1-9f84-14118cf21f2b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:16 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD Nov 03 17:16:16 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:16 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-6581b9c6-6991-4b9d-870d-d3510de7d3f7 req-520e7193-71d9-4cef-9692-625fdd8f3a0c tempest-TestStampPattern-1336895651 None] Terminate volume connection completed successfully. Nov 03 17:16:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-6581b9c6-6991-4b9d-870d-d3510de7d3f7 req-520e7193-71d9-4cef-9692-625fdd8f3a0c tempest-TestStampPattern-1336895651 None] Deleting attachment 9d052328-bbe6-471f-b915-fb80ff1d796e. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:16:17 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:17 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] 4d6008ab-d7f4-4403-8d44-c7c2165d2356 was qcow2, converting to qcow2 {{(pid=86661) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:16:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:17 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe Nov 03 17:16:17 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Flow 'volume_create_manager' (617be01b-d109-4fc5-880b-94007e9984b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd5dd04-33db-44c4-bd74-942356c148f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] Creating offline snapshot 23478080-1110-4ea4-beff-feeb07c0d65b of volume b347e638-dbeb-44c5-ae5b-7c5598bd4e6f {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e311e85f-90b7-4d31-b970-f093a25f6867]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd5dd04-33db-44c4-bd74-942356c148f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-406419249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb29dd4-429c-4c02-90ee-cd8912b83dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc6e5b25959474eb7b8a10d57069cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:19Z,use_quota=True,user_id='a8e9f04d7e2f400a95ce2f5b20a27b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eab05f2-c26d-48c2-9e62-db330bcc4cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eab05f2-c26d-48c2-9e62-db330bcc4cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df29c6e-8d36-48c4-98bc-397a9dc0bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df29c6e-8d36-48c4-98bc-397a9dc0bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb29dd4-429c-4c02-90ee-cd8912b83dc8', 'volume_name': 'volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9965b760-cfdd-4915-b517-1ab78f406f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9965b760-cfdd-4915-b517-1ab78f406f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce192fe5-723e-4134-97c1-a65a5afdff56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:18 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Volume 0cb29dd4-429c-4c02-90ee-cd8912b83dc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8', 'volume_size': 1} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Flow 'volume_create_manager' (7af3b56f-98ee-48d4-9a1e-35e347ec0239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:18 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f Nov 03 17:16:18 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08c6789-7573-4c30-a96d-174425ace60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08c6789-7573-4c30-a96d-174425ace60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1953113763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba267e85-07f2-4601-9df6-75f26e308d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebbfe05514644d79f8e6d5e6abf16e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:19Z,use_quota=True,user_id='d3f9de1485ac4b49a35e5049497baa2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697ada91-bc05-434e-8572-450e0935f84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697ada91-bc05-434e-8572-450e0935f84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3142ed-32a5-4ef1-acc5-0571dbdd7990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3142ed-32a5-4ef1-acc5-0571dbdd7990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba267e85-07f2-4601-9df6-75f26e308d1f', 'volume_name': 'volume-ba267e85-07f2-4601-9df6-75f26e308d1f', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7107ebcd-0652-49c7-acaa-fd3ecce36e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7107ebcd-0652-49c7-acaa-fd3ecce36e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14821c7-3a20-4e67-ae15-bc1329666106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:19 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Volume ba267e85-07f2-4601-9df6-75f26e308d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba267e85-07f2-4601-9df6-75f26e308d1f', 'volume_size': 1} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:19 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" returned: 0 in 0.430s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:19 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b 1G Nov 03 17:16:19 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:19 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe" returned: 0 in 2.108s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d6008ab-d7f4-4403-8d44-c7c2165d2356_g0b39vlmdevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:16:19 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Converted 112.00 MB image at 53.08 MB/s Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:19 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe 1G Nov 03 17:16:19 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:19 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe 1G" returned: 0 in 0.341s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Downloaded image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}])) to volume 654867ce-4002-4288-a2e7-687b96b09efe successfully. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Temporary image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 for user 85002aa83d574667bf4c275ddf630657 is deleted. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Marking volume 654867ce-4002-4288-a2e7-687b96b09efe as bootable. {{(pid=86661) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:16:19 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b 1G" returned: 0 in 0.448s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Copying metadata from image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 to 654867ce-4002-4288-a2e7-687b96b09efe. {{(pid=86661) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Creating volume glance metadata for volume 654867ce-4002-4288-a2e7-687b96b09efe backed by image 4d6008ab-d7f4-4403-8d44-c7c2165d2356 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86661) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:16:19 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b Nov 03 17:16:19 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb383d1-b859-455b-8cf4-7f07c5ad41f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654867ce-4002-4288-a2e7-687b96b09efe', 'volume_size': 1, 'image_id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '53e430c5aeb54512b90a660af3cf10b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d6008ab-d7f4-4403-8d44-c7c2165d2356', 'created_at': datetime.datetime(2026, 11, 3, 15, 54, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 15, 54, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d6008ab-d7f4-4403-8d44-c7c2165d2356/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaf8763-845b-4989-ae06-248c80f27192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:19 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Volume volume-654867ce-4002-4288-a2e7-687b96b09efe (654867ce-4002-4288-a2e7-687b96b09efe): created successfully Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaf8763-845b-4989-ae06-248c80f27192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Flow 'volume_create_manager' (5a293459-b7c6-4b6e-990d-7e6580ee21ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:19 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8442cd01-4b9b-48e0-9d9f-dcb6333a939a tempest-TestShelveInstance-1738874293 None] Created volume successfully. Nov 03 17:16:20 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b" returned: 0 in 0.356s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:20 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b is being set with open permissions: ugo+rw Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:20 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b Nov 03 17:16:20 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:20 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b" returned: 0 in 0.249s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:20 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.info Nov 03 17:16:20 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:20 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.info" returned: 0 in 0.267s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:20 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.info is being set with open permissions: ugo+rw Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:20 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.info Nov 03 17:16:20 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:20 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.info" returned: 0 in 0.265s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.182s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.995s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-406419249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb29dd4-429c-4c02-90ee-cd8912b83dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc6e5b25959474eb7b8a10d57069cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:19Z,use_quota=True,user_id='a8e9f04d7e2f400a95ce2f5b20a27b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Creating volume 0cb29dd4-429c-4c02-90ee-cd8912b83dc8 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:20 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:16:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:20 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8 1073741824 Nov 03 17:16:20 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:20 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-431e51d7-3315-4846-b5d4-1ee35ebccbee tempest-TestStampPattern-1336895651 None] Create snapshot completed successfully Nov 03 17:16:21 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8 1073741824" returned: 0 in 0.484s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:21 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8 Nov 03 17:16:21 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:21 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8" returned: 0 in 0.335s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.772s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1953113763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba267e85-07f2-4601-9df6-75f26e308d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebbfe05514644d79f8e6d5e6abf16e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:19Z,use_quota=True,user_id='d3f9de1485ac4b49a35e5049497baa2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Creating volume ba267e85-07f2-4601-9df6-75f26e308d1f {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:21 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce192fe5-723e-4134-97c1-a65a5afdff56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:21 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f 1073741824 Nov 03 17:16:21 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3fdd1f-1840-4b58-b297-9255edce7840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:21 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Volume volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8 (0cb29dd4-429c-4c02-90ee-cd8912b83dc8): created successfully Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3fdd1f-1840-4b58-b297-9255edce7840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:21 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Flow 'volume_create_manager' (617be01b-d109-4fc5-880b-94007e9984b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-88124504-1ad6-413f-baec-e0bc40ac3279 tempest-ProjectReaderTests-1094456894 None] Created volume successfully. Nov 03 17:16:22 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f 1073741824" returned: 0 in 0.619s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:22 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f Nov 03 17:16:22 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:22 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f" returned: 0 in 0.356s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14821c7-3a20-4e67-ae15-bc1329666106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba267e85-07f2-4601-9df6-75f26e308d1f', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be9d104-d591-432f-a55e-9ed29801dd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:22 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Volume volume-ba267e85-07f2-4601-9df6-75f26e308d1f (ba267e85-07f2-4601-9df6-75f26e308d1f): created successfully Nov 03 17:16:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be9d104-d591-432f-a55e-9ed29801dd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:22 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Flow 'volume_create_manager' (7af3b56f-98ee-48d4-9a1e-35e347ec0239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-4a1ac372-4914-446d-b8c1-e2cb62a5041b tempest-VolumeDependencyTests-10435742 None] Created volume successfully. Nov 03 17:16:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "cinder-0cb29dd4-429c-4c02-90ee-cd8912b83dc8-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-0cb29dd4-429c-4c02-90ee-cd8912b83dc8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "cinder-quobyte-0cb29dd4-429c-4c02-90ee-cd8912b83dc8" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-quobyte-0cb29dd4-429c-4c02-90ee-cd8912b83dc8" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:23 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[290fefb0-b9d7-404e-8d84-df46aa8ce674]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:23 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8 Nov 03 17:16:23 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-89073dc2-1878-46d2-bdc4-e65c9191469c req-a5729433-81e2-4801-8357-1ecd12b458bd tempest-TestShelveInstance-1738874293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-89073dc2-1878-46d2-bdc4-e65c9191469c req-a5729433-81e2-4801-8357-1ecd12b458bd tempest-TestShelveInstance-1738874293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-89073dc2-1878-46d2-bdc4-e65c9191469c req-a5729433-81e2-4801-8357-1ecd12b458bd tempest-TestShelveInstance-1738874293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:23 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8" returned: 0 in 0.554s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-89073dc2-1878-46d2-bdc4-e65c9191469c req-a5729433-81e2-4801-8357-1ecd12b458bd tempest-TestShelveInstance-1738874293 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-654867ce-4002-4288-a2e7-687b96b09efe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6d35350-750a-4b40-896e-8b50e8cc55bc', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:16:23 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8 Nov 03 17:16:23 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:23 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-89073dc2-1878-46d2-bdc4-e65c9191469c req-a5729433-81e2-4801-8357-1ecd12b458bd tempest-TestShelveInstance-1738874293 None] attachment_update completed successfully. Nov 03 17:16:24 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0cb29dd4-429c-4c02-90ee-cd8912b83dc8" returned: 0 in 0.508s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-quobyte-0cb29dd4-429c-4c02-90ee-cd8912b83dc8" released by "delete_volume" :: held 1.154s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] Creating offline snapshot be095a1d-7430-4eee-81ab-dd53dac75049 of volume ba267e85-07f2-4601-9df6-75f26e308d1f {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a998f853-d84e-4fdc-a92a-e5634cd0c91c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Created reservations ['37bf7856-f7bf-42b9-a85d-05f18ad83c19', 'd464a903-e382-4e9d-b9c4-9ac7bc7279a1', 'be0ce738-0841-442f-a698-00dd10ac394a', 'de370770-87ea-43bb-995c-03c7e5ac1eb4'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:24 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f Nov 03 17:16:24 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:24 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:24 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:24 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.357s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Deleted volume successfully. Nov 03 17:16:24 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f" returned: 0 in 0.568s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5bb0c4c8-9bc8-4169-8f6f-fa9023a0ec27 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-0cb29dd4-429c-4c02-90ee-cd8912b83dc8-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:24 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 1G Nov 03 17:16:24 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:25 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 1G" returned: 0 in 0.589s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba267e85-07f2-4601-9df6-75f26e308d1f -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:25 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba267e85-07f2-4601-9df6-75f26e308d1f -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 Nov 03 17:16:25 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:26 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba267e85-07f2-4601-9df6-75f26e308d1f -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049" returned: 0 in 0.493s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:26 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 is being set with open permissions: ugo+rw Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:26 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 Nov 03 17:16:26 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Flow 'volume_create_manager' (5e168961-3d82-4e15-be79-bea8da4078a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed41c8d-8fd5-484d-99a6-c843ad124521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed41c8d-8fd5-484d-99a6-c843ad124521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1718856471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab34f7c1-0d62-4769-ba97-6878d9b60ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc6e5b25959474eb7b8a10d57069cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:26Z,use_quota=True,user_id='a8e9f04d7e2f400a95ce2f5b20a27b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d991708a-65e0-46d6-b0d0-7817f5194a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d991708a-65e0-46d6-b0d0-7817f5194a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce0339e-ff2a-4382-8df4-c598fef2b61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce0339e-ff2a-4382-8df4-c598fef2b61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab34f7c1-0d62-4769-ba97-6878d9b60ddd', 'volume_name': 'volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba8eb2a-2fb1-43cf-bdf0-fd78fb4a482b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba8eb2a-2fb1-43cf-bdf0-fd78fb4a482b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ba9348-45d8-47b6-8e61-b315663ff523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:26 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Volume ab34f7c1-0d62-4769-ba97-6878d9b60ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd', 'volume_size': 1} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:26 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049" returned: 0 in 0.408s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:26 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.info Nov 03 17:16:26 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:26 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.info" returned: 0 in 0.366s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:26 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.info is being set with open permissions: ugo+rw Nov 03 17:16:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:26 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.info Nov 03 17:16:26 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:27 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.info" returned: 0 in 0.453s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.120s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.197s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1718856471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab34f7c1-0d62-4769-ba97-6878d9b60ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc6e5b25959474eb7b8a10d57069cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:26Z,use_quota=True,user_id='a8e9f04d7e2f400a95ce2f5b20a27b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Creating volume ab34f7c1-0d62-4769-ba97-6878d9b60ddd {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:27 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:16:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:27 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd 1073741824 Nov 03 17:16:27 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-152ea404-1d2a-43d1-adf3-65dc721c8543 tempest-VolumeDependencyTests-10435742 None] Create snapshot completed successfully Nov 03 17:16:28 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd 1073741824" returned: 0 in 0.793s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:28 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=141,cinder:INSERT=55,cinder:UPDATE=170,cinder:DELETE=14 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:16:28 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=153,cinder:INSERT=53,cinder:UPDATE=171,cinder:DELETE=17 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:16:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:28 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd Nov 03 17:16:28 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:28 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd" returned: 0 in 0.660s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ba9348-45d8-47b6-8e61-b315663ff523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84dbe35d-cc0a-4cb5-a533-5a29f6c37220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:29 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Volume volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd (ab34f7c1-0d62-4769-ba97-6878d9b60ddd): created successfully Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84dbe35d-cc0a-4cb5-a533-5a29f6c37220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Flow 'volume_create_manager' (5e168961-3d82-4e15-be79-bea8da4078a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:29 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5c9e5fd4-5d94-447a-874d-64a1f190b67b tempest-ProjectReaderTests-1094456894 None] Created volume successfully. Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "cinder-ab34f7c1-0d62-4769-ba97-6878d9b60ddd-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-ab34f7c1-0d62-4769-ba97-6878d9b60ddd-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "cinder-quobyte-ab34f7c1-0d62-4769-ba97-6878d9b60ddd" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-quobyte-ab34f7c1-0d62-4769-ba97-6878d9b60ddd" acquired by "delete_volume" :: waited 0.042s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76a8b7e-abb0-4f49-9eb0-1c117d2999f0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:29 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:29 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:30 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd Nov 03 17:16:30 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:30 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.499s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Flow 'volume_create_manager' (c49d00f5-6042-4a1b-9907-8d4d3717f488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186a4ad6-6a1c-4a5f-a1e4-9b3d2f70376d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186a4ad6-6a1c-4a5f-a1e4-9b3d2f70376d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1174128726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f25b4a7-2a05-48ab-a0b0-ace449c9849f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebbfe05514644d79f8e6d5e6abf16e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=be095a1d-7430-4eee-81ab-dd53dac75049,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:30Z,use_quota=True,user_id='d3f9de1485ac4b49a35e5049497baa2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fde0bd4-0e57-4ca7-af8c-751b9f1abbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fde0bd4-0e57-4ca7-af8c-751b9f1abbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d57015d-9d5b-4dec-8881-7249eff9cce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d57015d-9d5b-4dec-8881-7249eff9cce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1f25b4a7-2a05-48ab-a0b0-ace449c9849f', 'volume_name': 'volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f', 'volume_size': 1, 'snapshot_id': 'be095a1d-7430-4eee-81ab-dd53dac75049'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de64e9e-ae16-42b5-a20c-ed16817da842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de64e9e-ae16-42b5-a20c-ed16817da842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4a640e-2ffc-4f46-80f9-a151292d5e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:30 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Volume 1f25b4a7-2a05-48ab-a0b0-ace449c9849f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f', 'volume_size': 1, 'snapshot_id': 'be095a1d-7430-4eee-81ab-dd53dac75049'} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "cinder-quobyte-be095a1d-7430-4eee-81ab-dd53dac75049-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" by "_create_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-be095a1d-7430-4eee-81ab-dd53dac75049-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Creating volume 1f25b4a7-2a05-48ab-a0b0-ace449c9849f from snapshot be095a1d-7430-4eee-81ab-dd53dac75049 {{(pid=86661) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:30 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "cinder-quobyte-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd" returned: 0 in 0.696s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:30 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd Nov 03 17:16:30 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" acquired by "_copy_volume_from_snapshot" :: waited 0.072s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] snapshot: be095a1d-7430-4eee-81ab-dd53dac75049, volume: 1f25b4a7-2a05-48ab-a0b0-ace449c9849f, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ccc3df-2e75-41cb-a4bc-8b3069d24556]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:30 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ab34f7c1-0d62-4769-ba97-6878d9b60ddd" returned: 0 in 0.374s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:30 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 Nov 03 17:16:30 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-quobyte-ab34f7c1-0d62-4769-ba97-6878d9b60ddd" released by "delete_volume" :: held 1.193s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Created reservations ['1e2347f6-98e8-474c-88be-6666b34f26a3', '61cce7b9-e840-44b5-b235-b7a503bd89b9', 'e3ba1373-cc4b-4f16-9611-fef6d54569a4', 'b4b8c35e-fd04-423e-906a-49eab80e85e4'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:31 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:31 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:31 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049" returned: 0 in 0.513s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba267e85-07f2-4601-9df6-75f26e308d1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d47065a-e6d0-4858-9411-9de82a7b5707]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:31 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.308s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:31 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Deleted volume successfully. Nov 03 17:16:31 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f Nov 03 17:16:31 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6a68a4d7-133d-4ca6-860c-3e0b86b6b8d1 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-ab34f7c1-0d62-4769-ba97-6878d9b60ddd-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:31 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f" returned: 0 in 0.526s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:16:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:31 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f Nov 03 17:16:31 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:32 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Flow 'volume_create_manager' (711abbbd-f7df-47f9-9142-4a9ac8feac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ce3452-2d08-45a9-89bc-bc639e750aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ce3452-2d08-45a9-89bc-bc639e750aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225820446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505498d8-a841-4be8-81fb-819a746e4806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc6e5b25959474eb7b8a10d57069cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:33Z,use_quota=True,user_id='a8e9f04d7e2f400a95ce2f5b20a27b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f499f0-6b35-4722-9045-2f45a7a34f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:32 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f499f0-6b35-4722-9045-2f45a7a34f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ad94e1-aab4-4a7a-81b6-cd9cc5b9df7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ad94e1-aab4-4a7a-81b6-cd9cc5b9df7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505498d8-a841-4be8-81fb-819a746e4806', 'volume_name': 'volume-505498d8-a841-4be8-81fb-819a746e4806', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ac188b-1b8f-4b4f-a686-ad57d347c0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ac188b-1b8f-4b4f-a686-ad57d347c0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992f998a-c0bc-41fd-829a-515e5ba9984c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:33 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Volume 505498d8-a841-4be8-81fb-819a746e4806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505498d8-a841-4be8-81fb-819a746e4806', 'volume_size': 1} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Flow 'volume_create_manager' (17759182-d4f1-4790-bfc4-4ea672bbb812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f27a23d-7fa1-4da0-8c3d-3c3b1afd8518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f27a23d-7fa1-4da0-8c3d-3c3b1afd8518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1116360279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1690e77a-83a9-48b4-bd9c-02c08f29f43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a975efccb467585bd43dd7c3dfa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=23478080-1110-4ea4-beff-feeb07c0d65b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:34Z,use_quota=True,user_id='7b6c3347c37e467a91fc39322486d0ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02023f87-9f74-402e-8170-fe94e208c32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02023f87-9f74-402e-8170-fe94e208c32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ecf2a2-51ef-49e0-a910-a59823f786a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ecf2a2-51ef-49e0-a910-a59823f786a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1690e77a-83a9-48b4-bd9c-02c08f29f43b', 'volume_name': 'volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b', 'volume_size': 1, 'snapshot_id': '23478080-1110-4ea4-beff-feeb07c0d65b'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb7ff7e-a246-4b3d-8626-c2a638673481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb7ff7e-a246-4b3d-8626-c2a638673481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcebf44e-5c7f-4452-8396-ebc81f089891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:34 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Volume 1690e77a-83a9-48b4-bd9c-02c08f29f43b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b', 'volume_size': 1, 'snapshot_id': '23478080-1110-4ea4-beff-feeb07c0d65b'} Nov 03 17:16:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:43 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" returned: 0 in 11.307s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f, size 1024.00 MB, duration 11.31 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:16:43 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Converted 1024.00 MB image at 90.54 MB/s Nov 03 17:16:43 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f is being set with open permissions: ugo+rw Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:43 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f Nov 03 17:16:43 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:43 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" returned: 0 in 0.294s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" released by "_copy_volume_from_snapshot" :: held 12.877s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-be095a1d-7430-4eee-81ab-dd53dac75049-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" released by "_create_volume_from_snapshot" :: held 13.075s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.098s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.434s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225820446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505498d8-a841-4be8-81fb-819a746e4806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc6e5b25959474eb7b8a10d57069cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:33Z,use_quota=True,user_id='a8e9f04d7e2f400a95ce2f5b20a27b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Creating volume 505498d8-a841-4be8-81fb-819a746e4806 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:43 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4a640e-2ffc-4f46-80f9-a151292d5e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f', 'volume_size': 1, 'snapshot_id': 'be095a1d-7430-4eee-81ab-dd53dac75049'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4d3ded-1cdc-40e0-a711-2d7c32de428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:43 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Volume volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f (1f25b4a7-2a05-48ab-a0b0-ace449c9849f): created successfully Nov 03 17:16:43 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806 1073741824 Nov 03 17:16:43 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4d3ded-1cdc-40e0-a711-2d7c32de428a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Flow 'volume_create_manager' (c49d00f5-6042-4a1b-9907-8d4d3717f488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:43 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-47b7563b-6fae-42cf-9d67-57a9f20335a0 tempest-VolumeDependencyTests-10435742 None] Created volume successfully. Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "cinder-be095a1d-7430-4eee-81ab-dd53dac75049-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-be095a1d-7430-4eee-81ab-dd53dac75049-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "cinder-quobyte-ba267e85-07f2-4601-9df6-75f26e308d1f" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-ba267e85-07f2-4601-9df6-75f26e308d1f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "cinder-quobyte-be095a1d-7430-4eee-81ab-dd53dac75049" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-be095a1d-7430-4eee-81ab-dd53dac75049" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Deleting offline snapshot be095a1d-7430-4eee-81ab-dd53dac75049 of volume ba267e85-07f2-4601-9df6-75f26e308d1f {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] snapshot_file for this snap is: volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[75947e4c-e440-4e4c-9504-277d31b27f5a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:44 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806 1073741824" returned: 0 in 1.053s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:44 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 Nov 03 17:16:44 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:44 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806 Nov 03 17:16:44 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:45 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806" returned: 0 in 0.362s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.945s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Acquiring lock "cinder-quobyte-23478080-1110-4ea4-beff-feeb07c0d65b-1690e77a-83a9-48b4-bd9c-02c08f29f43b" by "_create_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992f998a-c0bc-41fd-829a-515e5ba9984c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505498d8-a841-4be8-81fb-819a746e4806', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb94c79-0989-43fc-8a4f-5ca31641b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-23478080-1110-4ea4-beff-feeb07c0d65b-1690e77a-83a9-48b4-bd9c-02c08f29f43b" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Creating volume 1690e77a-83a9-48b4-bd9c-02c08f29f43b from snapshot 23478080-1110-4ea4-beff-feeb07c0d65b {{(pid=86661) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Acquiring lock "cinder-quobyte-1690e77a-83a9-48b4-bd9c-02c08f29f43b" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:45 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Volume volume-505498d8-a841-4be8-81fb-819a746e4806 (505498d8-a841-4be8-81fb-819a746e4806): created successfully Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb94c79-0989-43fc-8a4f-5ca31641b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Flow 'volume_create_manager' (711abbbd-f7df-47f9-9142-4a9ac8feac24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-1690e77a-83a9-48b4-bd9c-02c08f29f43b" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] snapshot: 23478080-1110-4ea4-beff-feeb07c0d65b, volume: 1690e77a-83a9-48b4-bd9c-02c08f29f43b, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:16:45 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-41ed8941-59c3-476b-a660-13423dd9e45c tempest-ProjectReaderTests-1094456894 None] Created volume successfully. Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89b8375-184b-47d3-964c-b47e40d8a714]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049" returned: 0 in 0.925s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba267e85-07f2-4601-9df6-75f26e308d1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:16:45 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d194a31-6963-4f0f-a9fc-34aa78c05ce4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:45 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b Nov 03 17:16:45 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:45 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f Nov 03 17:16:45 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "cinder-505498d8-a841-4be8-81fb-819a746e4806-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-505498d8-a841-4be8-81fb-819a746e4806-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "cinder-quobyte-505498d8-a841-4be8-81fb-819a746e4806" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-quobyte-505498d8-a841-4be8-81fb-819a746e4806" acquired by "delete_volume" :: waited 0.057s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328c98c-497b-4955-90fb-2d8759ff9020]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:46 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b" returned: 0 in 0.705s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[752c9dca-0557-41e1-a461-83381021a664]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:46 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806 Nov 03 17:16:46 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:46 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f Nov 03 17:16:46 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:46 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f" returned: 0 in 1.006s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:46 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 Nov 03 17:16:46 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:46 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806" returned: 0 in 0.590s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:46 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806 Nov 03 17:16:46 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:46 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" returned: 0 in 0.678s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:46 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b Nov 03 17:16:46 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:46 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-505498d8-a841-4be8-81fb-819a746e4806" returned: 0 in 0.354s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-quobyte-505498d8-a841-4be8-81fb-819a746e4806" released by "delete_volume" :: held 1.030s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Created reservations ['4b28cbf0-0121-4c93-90ea-a3fa005fe361', 'd2f69b76-1247-4a9f-a7b7-27877d9f844d', '3de710da-7c1e-4196-9c61-61a563c2b6ee', 'df574c9e-f5eb-47fd-aa70-0d1d750517bf'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:47 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049" returned: 0 in 0.732s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:47 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049 Nov 03 17:16:47 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:47 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:47 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:47 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f.be095a1d-7430-4eee-81ab-dd53dac75049" returned: 0 in 0.718s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:47 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.678s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:47 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-be095a1d-7430-4eee-81ab-dd53dac75049" released by "_delete_snapshot" :: held 3.616s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Deleted volume successfully. Nov 03 17:16:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-ba267e85-07f2-4601-9df6-75f26e308d1f" released by "delete_snapshot" :: held 3.685s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35a0bdaf-a18e-498c-92c4-ec08be41b302 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-505498d8-a841-4be8-81fb-819a746e4806-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:48 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Created reservations ['0597529b-9763-46d8-9d95-2f557ecdbfd2', 'c1d67224-7d64-4d2f-b3d4-b6ca72b9c04c', '6f9facfc-1b9a-4693-ad69-f9ccad876f65', '011f509d-ff9b-4fcc-8bb9-d8a5c290fdbb'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Delete snapshot completed successfully. Nov 03 17:16:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1e5c2349-21f1-490e-9022-97ad78c62287 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-be095a1d-7430-4eee-81ab-dd53dac75049-delete_snapshot" released by "delete_snapshot" :: held 4.037s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "cinder-ba267e85-07f2-4601-9df6-75f26e308d1f-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-ba267e85-07f2-4601-9df6-75f26e308d1f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "cinder-quobyte-ba267e85-07f2-4601-9df6-75f26e308d1f" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-ba267e85-07f2-4601-9df6-75f26e308d1f" acquired by "delete_volume" :: waited 0.060s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:49 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3190b6-74ef-4be8-a12e-0a59424b0ad8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:49 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f Nov 03 17:16:49 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Flow 'volume_create_manager' (9901da43-c3d1-488e-89b2-5077ef9b77cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bae1296-18bc-4a0e-af37-e7f486bbf9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bae1296-18bc-4a0e-af37-e7f486bbf9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819734622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f0ef37-9389-477b-8f4e-1c1564d0c4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc6e5b25959474eb7b8a10d57069cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:50Z,use_quota=True,user_id='a8e9f04d7e2f400a95ce2f5b20a27b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ddbc52-894b-4330-b990-69637f446423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ddbc52-894b-4330-b990-69637f446423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74262b9-9b65-4b42-b3da-a25b2845d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:50 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74262b9-9b65-4b42-b3da-a25b2845d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f0ef37-9389-477b-8f4e-1c1564d0c4ae', 'volume_name': 'volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088b33a1-500e-49e0-a639-fd2551095a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088b33a1-500e-49e0-a639-fd2551095a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9db331d-e820-4c5e-b434-91a8727bc7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:50 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Volume 77f0ef37-9389-477b-8f4e-1c1564d0c4ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae', 'volume_size': 1} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f" returned: 0 in 1.079s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:50 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f Nov 03 17:16:50 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:51 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ba267e85-07f2-4601-9df6-75f26e308d1f" returned: 0 in 0.671s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-ba267e85-07f2-4601-9df6-75f26e308d1f" released by "delete_volume" :: held 2.136s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:51 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Created reservations ['87af2696-df07-45a0-a9aa-45bbda8e8858', '862d0e74-2144-497d-a8bd-a6fdc7af5269', '44943c9b-c5ae-4e11-b1f9-5319498931f1', '7b22edc9-069c-423b-98fe-b1cf98958601'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:51 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:51 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "cinder-1f25b4a7-2a05-48ab-a0b0-ace449c9849f-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-1f25b4a7-2a05-48ab-a0b0-ace449c9849f-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "cinder-quobyte-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:16:52 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.428s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:52 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:52 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Deleted volume successfully. Nov 03 17:16:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" acquired by "delete_volume" :: waited 0.044s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:16:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-8df919a6-ba16-4f40-8855-e9f68086a0c6 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-ba267e85-07f2-4601-9df6-75f26e308d1f-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:52 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e4391a-3acc-4c93-99d4-3e42d2c51944]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:16:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:52 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f Nov 03 17:16:52 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:53 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" returned: 0 in 1.335s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:53 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f Nov 03 17:16:53 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:54 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" returned: 0 in 0.641s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-quobyte-1f25b4a7-2a05-48ab-a0b0-ace449c9849f" released by "delete_volume" :: held 2.145s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:54 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Created reservations ['2e8187f2-f71c-46af-a7ea-fcec1b57ce56', '6be5e14e-c5c2-4b43-92ee-32fddc8fb46a', '26ae6727-11e9-47e4-915f-97be8c62d11e', '4f7fce31-527a-4650-bbf0-3e10d42ad29b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:16:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:54 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:16:54 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:55 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.803s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:55 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:16:55 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Deleted volume successfully. Nov 03 17:16:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-60433994-bf0f-4eff-854c-4745d5ebbd82 tempest-VolumeDependencyTests-10435742 None] Lock "cinder-1f25b4a7-2a05-48ab-a0b0-ace449c9849f-delete_volume" released by "delete_volume" :: held 3.634s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b" returned: 0 in 12.496s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f, size 1024.00 MB, duration 12.50 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:16:59 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Converted 1024.00 MB image at 81.92 MB/s Nov 03 17:16:59 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b is being set with open permissions: ugo+rw Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:59 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b Nov 03 17:16:59 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:59 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b" returned: 0 in 0.462s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-1690e77a-83a9-48b4-bd9c-02c08f29f43b" released by "_copy_volume_from_snapshot" :: held 14.527s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-23478080-1110-4ea4-beff-feeb07c0d65b-1690e77a-83a9-48b4-bd9c-02c08f29f43b" released by "_create_volume_from_snapshot" :: held 14.644s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.701s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.144s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819734622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f0ef37-9389-477b-8f4e-1c1564d0c4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc6e5b25959474eb7b8a10d57069cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:16:50Z,use_quota=True,user_id='a8e9f04d7e2f400a95ce2f5b20a27b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Creating volume 77f0ef37-9389-477b-8f4e-1c1564d0c4ae {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:16:59 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:16:59 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae 1073741824 Nov 03 17:16:59 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcebf44e-5c7f-4452-8396-ebc81f089891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b', 'volume_size': 1, 'snapshot_id': '23478080-1110-4ea4-beff-feeb07c0d65b'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f843f9ed-36b2-42ef-a8c3-c328beb8eb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:16:59 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Volume volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b (1690e77a-83a9-48b4-bd9c-02c08f29f43b): created successfully Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f843f9ed-36b2-42ef-a8c3-c328beb8eb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:16:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Flow 'volume_create_manager' (17759182-d4f1-4790-bfc4-4ea672bbb812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:16:59 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c5a92a06-f811-45bb-a744-c28e7b5cefd6 tempest-TestStampPattern-1336895651 None] Created volume successfully. Nov 03 17:17:00 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae 1073741824" returned: 0 in 1.097s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:01 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae Nov 03 17:17:01 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:01 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae" returned: 0 in 0.761s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:17:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9db331d-e820-4c5e-b434-91a8727bc7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:17:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e226f24-bc6b-43dc-890a-cd01b5c09aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:17:01 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Volume volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae (77f0ef37-9389-477b-8f4e-1c1564d0c4ae): created successfully Nov 03 17:17:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e226f24-bc6b-43dc-890a-cd01b5c09aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:17:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Flow 'volume_create_manager' (9901da43-c3d1-488e-89b2-5077ef9b77cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:17:01 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-30a02ad6-e9d1-4254-8258-65d40d66f3fb tempest-ProjectReaderTests-1094456894 None] Created volume successfully. Nov 03 17:17:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "cinder-77f0ef37-9389-477b-8f4e-1c1564d0c4ae-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:17:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-77f0ef37-9389-477b-8f4e-1c1564d0c4ae-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:17:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "cinder-quobyte-77f0ef37-9389-477b-8f4e-1c1564d0c4ae" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:17:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-quobyte-77f0ef37-9389-477b-8f4e-1c1564d0c4ae" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:17:03 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5116c24c-d98a-4431-8d84-164020e42b59]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:17:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:03 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae Nov 03 17:17:03 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:03 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae" returned: 0 in 0.508s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:03 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae Nov 03 17:17:03 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:03 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-77f0ef37-9389-477b-8f4e-1c1564d0c4ae" returned: 0 in 0.278s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-quobyte-77f0ef37-9389-477b-8f4e-1c1564d0c4ae" released by "delete_volume" :: held 0.882s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:17:04 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Created reservations ['729fa943-cf1d-4b7e-9076-cb93fbbba9bc', '7549ee95-1c1b-41fb-9f41-ff5d09e1c97b', 'd063b8e8-ce60-419f-a761-ff5d0d07343a', '633539cb-b3ed-48fb-975d-6e1ab34695c0'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:17:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:04 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:17:04 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:04 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.360s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:04 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:17:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Deleted volume successfully. Nov 03 17:17:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-efc9c416-ed03-40fd-bda2-8b49f001f2d0 tempest-ProjectReaderTests-1094456894 None] Lock "cinder-77f0ef37-9389-477b-8f4e-1c1564d0c4ae-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:17:05 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-b00c8ead-4b30-4139-93a3-7ce851a0e483 req-522312be-b6bd-4b97-8a6e-f0aec3957618 tempest-TestShelveInstance-1738874293 None] Terminate volume connection completed successfully. Nov 03 17:17:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-b00c8ead-4b30-4139-93a3-7ce851a0e483 req-522312be-b6bd-4b97-8a6e-f0aec3957618 tempest-TestShelveInstance-1738874293 None] Deleting attachment a6d35350-750a-4b40-896e-8b50e8cc55bc. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:17:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-5b27ec57-e80a-41bb-b00d-361ff0544410 req-83fc824a-cb9a-4fc1-90cd-6c128f091724 tempest-TestShelveInstance-1738874293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-5b27ec57-e80a-41bb-b00d-361ff0544410 req-83fc824a-cb9a-4fc1-90cd-6c128f091724 tempest-TestShelveInstance-1738874293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-5b27ec57-e80a-41bb-b00d-361ff0544410 req-83fc824a-cb9a-4fc1-90cd-6c128f091724 tempest-TestShelveInstance-1738874293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-5b27ec57-e80a-41bb-b00d-361ff0544410 req-83fc824a-cb9a-4fc1-90cd-6c128f091724 tempest-TestShelveInstance-1738874293 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-654867ce-4002-4288-a2e7-687b96b09efe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d643de7-9fdc-40ee-96c2-f879093fa197', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:17:08 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-5b27ec57-e80a-41bb-b00d-361ff0544410 req-83fc824a-cb9a-4fc1-90cd-6c128f091724 tempest-TestShelveInstance-1738874293 None] attachment_update completed successfully. Nov 03 17:17:18 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=42,cinder:INSERT=16,cinder:UPDATE=63,cinder:DELETE=6 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:17:18 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=60,cinder:SELECT=58,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:17:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-bae1036a-7548-47b8-bd4d-1a7717ae249e req-01e36c73-d662-4938-86c5-aee5e9919d7f tempest-TestStampPattern-1336895651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-bae1036a-7548-47b8-bd4d-1a7717ae249e req-01e36c73-d662-4938-86c5-aee5e9919d7f tempest-TestStampPattern-1336895651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-bae1036a-7548-47b8-bd4d-1a7717ae249e req-01e36c73-d662-4938-86c5-aee5e9919d7f tempest-TestStampPattern-1336895651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:23 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-bae1036a-7548-47b8-bd4d-1a7717ae249e req-01e36c73-d662-4938-86c5-aee5e9919d7f tempest-TestStampPattern-1336895651 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2', 'name': 'volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a0fd238-d992-46e3-8fa6-105a4030c4bb', 'enforce_multipath': True} {{(pid=86661) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 17:17:23 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-bae1036a-7548-47b8-bd4d-1a7717ae249e req-01e36c73-d662-4938-86c5-aee5e9919d7f tempest-TestStampPattern-1336895651 None] attachment_update completed successfully. Nov 03 17:17:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-f0ebca0c-8622-4cde-ade6-8317e85101a5 req-5c9d9e72-3cff-4500-814a-8bf2cbf963dd tempest-TestStampPattern-1336895651 None] Terminate volume connection completed successfully. Nov 03 17:17:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-f0ebca0c-8622-4cde-ade6-8317e85101a5 req-5c9d9e72-3cff-4500-814a-8bf2cbf963dd tempest-TestStampPattern-1336895651 None] Deleting attachment 5a0fd238-d992-46e3-8fa6-105a4030c4bb. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:17:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:17:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:29 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:17:29 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:30 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.282s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Acquiring lock "cinder-1690e77a-83a9-48b4-bd9c-02c08f29f43b-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Lock "cinder-1690e77a-83a9-48b4-bd9c-02c08f29f43b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Acquiring lock "cinder-quobyte-1690e77a-83a9-48b4-bd9c-02c08f29f43b" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-1690e77a-83a9-48b4-bd9c-02c08f29f43b" acquired by "delete_volume" :: waited 0.014s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c6e41b-9cd8-494b-bb15-2a16255868df]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:30 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b Nov 03 17:17:30 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:30 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b" returned: 0 in 0.379s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:30 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b Nov 03 17:17:30 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:31 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1690e77a-83a9-48b4-bd9c-02c08f29f43b" returned: 0 in 0.271s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-1690e77a-83a9-48b4-bd9c-02c08f29f43b" released by "delete_volume" :: held 0.710s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Created reservations ['ff39bc7d-e6ea-4b9e-af1a-31cb5654e8f5', '7c5b25ff-8822-4cb4-8e3d-1a902222d2d1', '6c1b026a-44fd-439d-b85c-42a806168fb6', 'c48e81d0-dedd-40d0-bcab-3ec8e48a810e'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:31 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:17:31 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:31 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.247s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:17:31 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Deleted volume successfully. Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-13f8612c-eaef-408f-b3e9-e525c88da15b tempest-TestStampPattern-1336895651 None] Lock "cinder-1690e77a-83a9-48b4-bd9c-02c08f29f43b-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Acquiring lock "cinder-23478080-1110-4ea4-beff-feeb07c0d65b-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Lock "cinder-23478080-1110-4ea4-beff-feeb07c0d65b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Acquiring lock "cinder-quobyte-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Acquiring lock "cinder-quobyte-23478080-1110-4ea4-beff-feeb07c0d65b" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-23478080-1110-4ea4-beff-feeb07c0d65b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Deleting offline snapshot 23478080-1110-4ea4-beff-feeb07c0d65b of volume b347e638-dbeb-44c5-ae5b-7c5598bd4e6f {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] snapshot_file for this snap is: volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecb9dc0-85f3-4cee-a5a1-84ca906e3f84]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:17:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:31 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b Nov 03 17:17:31 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:32 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b" returned: 0 in 0.384s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:17:32 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aa81a9-f2be-40fd-851b-3b06feaac82c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:17:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:32 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f Nov 03 17:17:32 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:32 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" returned: 0 in 0.510s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:32 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b Nov 03 17:17:32 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:33 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b" returned: 0 in 0.326s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:33 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b Nov 03 17:17:33 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:33 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f.23478080-1110-4ea4-beff-feeb07c0d65b" returned: 0 in 0.252s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-23478080-1110-4ea4-beff-feeb07c0d65b" released by "_delete_snapshot" :: held 1.581s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:17:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" released by "delete_snapshot" :: held 1.605s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:17:33 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Created reservations ['a33d27a4-80bc-447f-b01b-dac2f332d8d8', '15e2cf55-683a-4c62-93fc-e62bcd75d2f4', '2775d462-4608-43c6-83ca-1554b47c674d', '20bc15a2-7cc0-45d9-9431-f7c31d4bf5a8'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:17:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Delete snapshot completed successfully. Nov 03 17:17:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d4d55b08-84cc-4707-a729-c15807c6cebb tempest-TestStampPattern-1336895651 None] Lock "cinder-23478080-1110-4ea4-beff-feeb07c0d65b-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:17:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Acquiring lock "cinder-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:17:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Lock "cinder-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:17:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Acquiring lock "cinder-quobyte-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:17:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:17:36 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[10931cc9-087f-41fb-9f60-4f8e7c7ab5cc]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:17:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:36 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f Nov 03 17:17:36 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:36 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" returned: 0 in 0.406s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:37 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f Nov 03 17:17:37 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:37 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" returned: 0 in 0.261s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Lock "cinder-quobyte-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f" released by "delete_volume" :: held 0.740s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Created reservations ['207037a8-f364-47d5-a721-d154e0de87b0', '8d276065-8d3e-4a46-8f6f-d20679f17c73', '9369d789-d889-48a1-babf-146c8791680c', '7b31c6d7-f53c-4276-8be9-2c02979dfc7b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:37 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:17:37 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:37 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.263s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:17:37 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Deleted volume successfully. Nov 03 17:17:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-76f3b90f-50e7-4187-ae62-fbdd37f38d3a tempest-TestStampPattern-1336895651 None] Lock "cinder-b347e638-dbeb-44c5-ae5b-7c5598bd4e6f-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:17:47 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=27,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:17:47 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=19,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:17:52 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-f96323ea-0fc7-4139-a1b4-d965043f9329 tempest-TestShelveInstance-1738874293 None] Terminate volume connection completed successfully. Nov 03 17:17:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-f96323ea-0fc7-4139-a1b4-d965043f9329 tempest-TestShelveInstance-1738874293 None] Deleting attachment 7d643de7-9fdc-40ee-96c2-f879093fa197. {{(pid=86661) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 17:17:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Acquiring lock "cinder-654867ce-4002-4288-a2e7-687b96b09efe-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:17:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Lock "cinder-654867ce-4002-4288-a2e7-687b96b09efe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:17:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Acquiring lock "cinder-quobyte-654867ce-4002-4288-a2e7-687b96b09efe" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:17:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Lock "cinder-quobyte-654867ce-4002-4288-a2e7-687b96b09efe" acquired by "delete_volume" :: waited 0.034s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:17:53 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab56aed2-2226-4f2f-b808-c9bd439d20f0]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:17:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:53 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe Nov 03 17:17:53 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:53 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe" returned: 0 in 0.408s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:53 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe Nov 03 17:17:53 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:53 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-654867ce-4002-4288-a2e7-687b96b09efe" returned: 0 in 0.297s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Lock "cinder-quobyte-654867ce-4002-4288-a2e7-687b96b09efe" released by "delete_volume" :: held 0.759s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:17:54 devstack cinder-volume[86661]: DEBUG cinder.quota [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Created reservations ['dbc4e479-ed8f-4aab-ad87-ea846828fea7', 'c1c05ae7-d7c3-4940-ba03-43cfb41e1b39', '23021efe-71c3-4839-88f6-e0485d6494a9', 'dfb7cfd6-a182-4506-97c3-1fefbde36be4'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:17:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:17:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:17:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:17:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:17:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:17:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:17:54 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:17:54 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:17:54 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Nov 03 17:17:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.277s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:17:54 devstack cinder-volume[86661]: DEBUG cinder.manager [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:17:54 devstack cinder-volume[86661]: INFO cinder.volume.manager [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Deleted volume successfully. Nov 03 17:17:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [req-e7eaffd7-8eed-4aaa-9aa5-986749d0ceb3 req-6fa3c22a-448b-4e92-8868-2b072a7e04f8 tempest-TestShelveInstance-1738874293 None] Lock "cinder-654867ce-4002-4288-a2e7-687b96b09efe-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:04 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=11,cinder:SELECT=4,cinder:INSERT=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:18:04 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (2b6ba1e6-867c-4b33-a840-6b0e93a81b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438e277f-953d-4c0b-9f2b-416eafa0e72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438e277f-953d-4c0b-9f2b-416eafa0e72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556230597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a436068-ec8b-4d40-a3c4-7d94853b901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:12Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6701aeab-443e-49ac-bac3-23f022707dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6701aeab-443e-49ac-bac3-23f022707dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53347040-c061-43f2-a910-3be4d936987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53347040-c061-43f2-a910-3be4d936987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a436068-ec8b-4d40-a3c4-7d94853b901e', 'volume_name': 'volume-5a436068-ec8b-4d40-a3c4-7d94853b901e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cddc81-69fb-41c4-84e4-2de29dea2f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cddc81-69fb-41c4-84e4-2de29dea2f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9d86c0-4385-4a6b-83ab-789bc81ed1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:12 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume 5a436068-ec8b-4d40-a3c4-7d94853b901e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a436068-ec8b-4d40-a3c4-7d94853b901e', 'volume_size': 1} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556230597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a436068-ec8b-4d40-a3c4-7d94853b901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:12Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Creating volume 5a436068-ec8b-4d40-a3c4-7d94853b901e {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:18:12 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:12 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e 1073741824 Nov 03 17:18:12 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:12 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e 1073741824" returned: 0 in 0.394s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:12 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e Nov 03 17:18:12 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:13 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e" returned: 0 in 0.235s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9d86c0-4385-4a6b-83ab-789bc81ed1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a436068-ec8b-4d40-a3c4-7d94853b901e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2a2313-5d4d-4c6b-b43d-670147279f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:13 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume volume-5a436068-ec8b-4d40-a3c4-7d94853b901e (5a436068-ec8b-4d40-a3c4-7d94853b901e): created successfully Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2a2313-5d4d-4c6b-b43d-670147279f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (2b6ba1e6-867c-4b33-a840-6b0e93a81b64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:13 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-10a8201f-4745-4157-ad84-67d6d30c9f84 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created volume successfully. Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (25c82f70-1c15-4781-b04f-ed16a710f8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bea20e-3b06-4acf-a257-93798c0962c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bea20e-3b06-4acf-a257-93798c0962c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-795806449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa01aee-f0a4-47e8-a910-2d86e7b34f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:14Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cb739a-99ec-4222-9c87-70eddedbd062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cb739a-99ec-4222-9c87-70eddedbd062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4f28cf-c7b9-489a-8f82-3ba2e06b23a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4f28cf-c7b9-489a-8f82-3ba2e06b23a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa01aee-f0a4-47e8-a910-2d86e7b34f79', 'volume_name': 'volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c245c9e4-a1e3-4947-ac6a-6bf836d8a68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c245c9e4-a1e3-4947-ac6a-6bf836d8a68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b75c6c-588b-4e9a-9fcd-cc79f8f3ef72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:13 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume 1aa01aee-f0a4-47e8-a910-2d86e7b34f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79', 'volume_size': 1} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-795806449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa01aee-f0a4-47e8-a910-2d86e7b34f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:14Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Creating volume 1aa01aee-f0a4-47e8-a910-2d86e7b34f79 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:18:13 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:18:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:13 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79 1073741824 Nov 03 17:18:13 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (1f3c5788-f640-4ea9-be36-b23dc5a9359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120e67b7-76a4-4d8c-8d02-fa49b84e1980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120e67b7-76a4-4d8c-8d02-fa49b84e1980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1116306673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a71df3a-0003-40d1-8095-7cef102afc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:14Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fa3522-9e53-42f0-b10f-f19e88d63226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fa3522-9e53-42f0-b10f-f19e88d63226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f957c172-c712-4514-946a-16b89d167f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f957c172-c712-4514-946a-16b89d167f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a71df3a-0003-40d1-8095-7cef102afc2c', 'volume_name': 'volume-3a71df3a-0003-40d1-8095-7cef102afc2c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e62a7f4-0a8c-4910-a2b1-f5a325a99f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e62a7f4-0a8c-4910-a2b1-f5a325a99f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9599218-6e5e-45f4-9f9c-3f948c785830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:14 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume 3a71df3a-0003-40d1-8095-7cef102afc2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a71df3a-0003-40d1-8095-7cef102afc2c', 'volume_size': 1} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:14 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79 1073741824" returned: 0 in 0.577s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:14 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79 Nov 03 17:18:14 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (0990ae2c-7369-4035-8104-bd71c23459c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6bc46b-eca4-4f88-807b-4ff0346e68f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6bc46b-eca4-4f88-807b-4ff0346e68f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1935520360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6950e585-f412-4d79-ba79-780abb613df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:15Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbad5fa6-a009-408b-82ee-341fe0a67ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbad5fa6-a009-408b-82ee-341fe0a67ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968eb9b9-b30a-464f-8a9d-5e0ddc92c268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968eb9b9-b30a-464f-8a9d-5e0ddc92c268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6950e585-f412-4d79-ba79-780abb613df5', 'volume_name': 'volume-6950e585-f412-4d79-ba79-780abb613df5', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be21599-311b-4e61-9a66-0798672e5340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be21599-311b-4e61-9a66-0798672e5340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28dee3a-0133-4204-9efc-3ffb9d41d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:14 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume 6950e585-f412-4d79-ba79-780abb613df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6950e585-f412-4d79-ba79-780abb613df5', 'volume_size': 1} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:14 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79" returned: 0 in 0.312s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1116306673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a71df3a-0003-40d1-8095-7cef102afc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:14Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Creating volume 3a71df3a-0003-40d1-8095-7cef102afc2c {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:18:14 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:14 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c 1073741824 Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b75c6c-588b-4e9a-9fcd-cc79f8f3ef72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:14 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2550f5-c4b0-4689-9df6-e34f8dd6d50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:14 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79 (1aa01aee-f0a4-47e8-a910-2d86e7b34f79): created successfully Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2550f5-c4b0-4689-9df6-e34f8dd6d50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (25c82f70-1c15-4781-b04f-ed16a710f8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:14 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-bcedae6e-58e8-49b9-977c-19ae9db205b6 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created volume successfully. Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (8c9bb565-3a7b-4c0d-84c1-50eb541700c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3c8158-8f0a-4b27-839c-0519833a8d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3c8158-8f0a-4b27-839c-0519833a8d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1458868764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2a49a6-ec19-4b04-8722-82602cb27961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:15Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242277fd-1341-4d88-b351-9b770fda02f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242277fd-1341-4d88-b351-9b770fda02f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c6972d-f014-4830-9e96-7a411971d676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c6972d-f014-4830-9e96-7a411971d676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e2a49a6-ec19-4b04-8722-82602cb27961', 'volume_name': 'volume-2e2a49a6-ec19-4b04-8722-82602cb27961', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61b82ca-3b6c-4e42-9cea-b657b0a04710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61b82ca-3b6c-4e42-9cea-b657b0a04710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653cff8a-0e18-4f61-838d-474fac2259de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:15 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume 2e2a49a6-ec19-4b04-8722-82602cb27961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e2a49a6-ec19-4b04-8722-82602cb27961', 'volume_size': 1} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:15 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c 1073741824" returned: 0 in 0.557s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:15 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c Nov 03 17:18:15 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (cbf2786c-5904-4ba7-9c7d-8f80a9576c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0804b5-bf83-4bda-99d4-633fb761dfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0804b5-bf83-4bda-99d4-633fb761dfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1701115007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a45b795-e729-4adb-8598-4a74d060ff32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:15Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42fab1c-143d-45fa-bbf1-88eff81976dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42fab1c-143d-45fa-bbf1-88eff81976dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2817cc-5022-434a-b6bd-4945c47d8e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2817cc-5022-434a-b6bd-4945c47d8e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a45b795-e729-4adb-8598-4a74d060ff32', 'volume_name': 'volume-6a45b795-e729-4adb-8598-4a74d060ff32', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d23c19-b891-47ac-bb5b-3a53e0956c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d23c19-b891-47ac-bb5b-3a53e0956c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4148388e-bc7d-48b4-9d32-61357b52c578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:15 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume 6a45b795-e729-4adb-8598-4a74d060ff32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a45b795-e729-4adb-8598-4a74d060ff32', 'volume_size': 1} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:15 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c" returned: 0 in 0.277s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1935520360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6950e585-f412-4d79-ba79-780abb613df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:15Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Creating volume 6950e585-f412-4d79-ba79-780abb613df5 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:18:15 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:15 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5 1073741824 Nov 03 17:18:15 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9599218-6e5e-45f4-9f9c-3f948c785830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a71df3a-0003-40d1-8095-7cef102afc2c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a234ecf-6f78-47b1-be98-78e4bbb064b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:15 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume volume-3a71df3a-0003-40d1-8095-7cef102afc2c (3a71df3a-0003-40d1-8095-7cef102afc2c): created successfully Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a234ecf-6f78-47b1-be98-78e4bbb064b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (1f3c5788-f640-4ea9-be36-b23dc5a9359a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:15 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a42def45-a137-45e4-9837-967ae886c89e tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created volume successfully. Nov 03 17:18:16 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5 1073741824" returned: 0 in 0.419s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:16 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5 Nov 03 17:18:16 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:16 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5" returned: 0 in 0.222s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.242s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1458868764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2a49a6-ec19-4b04-8722-82602cb27961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:15Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Creating volume 2e2a49a6-ec19-4b04-8722-82602cb27961 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:18:16 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28dee3a-0133-4204-9efc-3ffb9d41d579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6950e585-f412-4d79-ba79-780abb613df5', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:16 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961 1073741824 Nov 03 17:18:16 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb60325-fabf-4897-af53-d63d108748d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:16 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume volume-6950e585-f412-4d79-ba79-780abb613df5 (6950e585-f412-4d79-ba79-780abb613df5): created successfully Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb60325-fabf-4897-af53-d63d108748d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (0990ae2c-7369-4035-8104-bd71c23459c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:16 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8ed36d4a-5c82-4929-bec2-e4aa8214f7c2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created volume successfully. Nov 03 17:18:16 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961 1073741824" returned: 0 in 0.427s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:16 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961 Nov 03 17:18:16 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:17 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961" returned: 0 in 0.223s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.538s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1701115007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a45b795-e729-4adb-8598-4a74d060ff32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b952d1f1c41718e194538cb121985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:15Z,use_quota=True,user_id='b119fd3a5f654d5980707d47b799b690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Creating volume 6a45b795-e729-4adb-8598-4a74d060ff32 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:18:17 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653cff8a-0e18-4f61-838d-474fac2259de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e2a49a6-ec19-4b04-8722-82602cb27961', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:17 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32 1073741824 Nov 03 17:18:17 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cd184a-dbf4-4391-9daa-0c349bb3155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:17 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume volume-2e2a49a6-ec19-4b04-8722-82602cb27961 (2e2a49a6-ec19-4b04-8722-82602cb27961): created successfully Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cd184a-dbf4-4391-9daa-0c349bb3155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (8c9bb565-3a7b-4c0d-84c1-50eb541700c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:17 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b82a4c32-baf9-429d-a7d4-c149a5cdd349 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created volume successfully. Nov 03 17:18:17 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32 1073741824" returned: 0 in 0.399s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:17 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32 Nov 03 17:18:17 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:17 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32" returned: 0 in 0.250s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4148388e-bc7d-48b4-9d32-61357b52c578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a45b795-e729-4adb-8598-4a74d060ff32', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cd483a-9d14-4d75-9ed9-2c77f5e66135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:17 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Volume volume-6a45b795-e729-4adb-8598-4a74d060ff32 (6a45b795-e729-4adb-8598-4a74d060ff32): created successfully Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cd483a-9d14-4d75-9ed9-2c77f5e66135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Flow 'volume_create_manager' (cbf2786c-5904-4ba7-9c7d-8f80a9576c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:17 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-9b9da41e-5c58-46ca-8689-6f78ab5f240b tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created volume successfully. Nov 03 17:18:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-6a45b795-e729-4adb-8598-4a74d060ff32-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-6a45b795-e729-4adb-8598-4a74d060ff32-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-quobyte-6a45b795-e729-4adb-8598-4a74d060ff32" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-6a45b795-e729-4adb-8598-4a74d060ff32" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f734d8-c9f0-485f-b913-8c9d420a7588]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:19 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32 Nov 03 17:18:19 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:19 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32" returned: 0 in 0.340s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:19 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32 Nov 03 17:18:19 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:19 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6a45b795-e729-4adb-8598-4a74d060ff32" returned: 0 in 0.246s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-6a45b795-e729-4adb-8598-4a74d060ff32" released by "delete_volume" :: held 0.627s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created reservations ['0b66f4dd-94fa-4b48-9b4c-db13468605c2', 'e4c398ae-7d59-4d77-91eb-3b04a9216968', 'd1bb425c-63aa-443f-a1ae-c0bf31edfd7e', 'df51686f-cd79-47fc-a846-356881509fea'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:19 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:18:19 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:19 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.242s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:19 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:18:20 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Deleted volume successfully. Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d806de7c-e85e-4d1f-bec4-d5ab40f6b9d1 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-6a45b795-e729-4adb-8598-4a74d060ff32-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-2e2a49a6-ec19-4b04-8722-82602cb27961-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-2e2a49a6-ec19-4b04-8722-82602cb27961-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-quobyte-2e2a49a6-ec19-4b04-8722-82602cb27961" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-2e2a49a6-ec19-4b04-8722-82602cb27961" acquired by "delete_volume" :: waited 0.014s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cda165-eefd-4adb-84f4-da67525383fb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:20 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961 Nov 03 17:18:20 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:20 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961" returned: 0 in 0.381s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:20 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961 Nov 03 17:18:20 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:20 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-2e2a49a6-ec19-4b04-8722-82602cb27961" returned: 0 in 0.258s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-2e2a49a6-ec19-4b04-8722-82602cb27961" released by "delete_volume" :: held 0.683s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created reservations ['2f0a5552-1739-4787-9f9e-965818ed4dd8', '92e761e3-dc26-41a6-ba2d-4d520327440c', 'a988e893-4556-4d5c-aa6f-261ea1f5149d', '6e9d1fac-1d21-4e19-be7f-9d92d128a1d7'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:21 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:18:21 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:21 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.274s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:21 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:18:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Deleted volume successfully. Nov 03 17:18:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6e907c71-39e3-4643-9cf5-70819cf29079 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-2e2a49a6-ec19-4b04-8722-82602cb27961-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-6950e585-f412-4d79-ba79-780abb613df5-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-6950e585-f412-4d79-ba79-780abb613df5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-quobyte-6950e585-f412-4d79-ba79-780abb613df5" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-6950e585-f412-4d79-ba79-780abb613df5" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:21 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c18c15-2677-4ee8-817d-ed41c61f93b4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:18:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:21 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5 Nov 03 17:18:21 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:21 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5" returned: 0 in 0.390s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:21 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5 Nov 03 17:18:21 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:22 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6950e585-f412-4d79-ba79-780abb613df5" returned: 0 in 0.244s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-6950e585-f412-4d79-ba79-780abb613df5" released by "delete_volume" :: held 0.674s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created reservations ['8d119fd4-cbd6-450c-a784-023ce9488804', '15bbc09d-6fe2-4844-957f-e06d8800951e', '83147682-c4ff-4f46-a9ac-1ae8cdd9a786', 'c39c2c12-e50c-4b35-a651-a808da8df2d2'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:22 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:18:22 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:22 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.260s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:18:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Deleted volume successfully. Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d9b2853-23be-403d-86d1-3b4ee36b4db8 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-6950e585-f412-4d79-ba79-780abb613df5-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-3a71df3a-0003-40d1-8095-7cef102afc2c-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-3a71df3a-0003-40d1-8095-7cef102afc2c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-quobyte-3a71df3a-0003-40d1-8095-7cef102afc2c" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-3a71df3a-0003-40d1-8095-7cef102afc2c" acquired by "delete_volume" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab00291-9f3e-406c-a9b7-2582736f7da8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:22 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c Nov 03 17:18:22 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:22 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c" returned: 0 in 0.359s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:22 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c Nov 03 17:18:22 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:23 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3a71df3a-0003-40d1-8095-7cef102afc2c" returned: 0 in 0.245s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-3a71df3a-0003-40d1-8095-7cef102afc2c" released by "delete_volume" :: held 0.647s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created reservations ['2340bea6-9b85-4d24-ba63-27e176ab818b', '6e5513f0-c008-421e-8be4-a5fbda526d11', 'a32f71ab-bd31-4eb1-85ab-f15173af1c27', 'd0169df1-bd51-496f-bbf1-27b368e402fc'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:23 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:18:23 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:23 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.243s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:18:23 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Deleted volume successfully. Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ff39d8e7-0b61-4be2-8015-09d4f1ffa1f3 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-3a71df3a-0003-40d1-8095-7cef102afc2c-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-1aa01aee-f0a4-47e8-a910-2d86e7b34f79-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-1aa01aee-f0a4-47e8-a910-2d86e7b34f79-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-quobyte-1aa01aee-f0a4-47e8-a910-2d86e7b34f79" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-1aa01aee-f0a4-47e8-a910-2d86e7b34f79" acquired by "delete_volume" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb906b64-0ae5-420d-ba3e-0d29f5d0c2cf]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:18:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:23 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79 Nov 03 17:18:23 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:24 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79" returned: 0 in 0.396s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:24 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79 Nov 03 17:18:24 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:24 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1aa01aee-f0a4-47e8-a910-2d86e7b34f79" returned: 0 in 0.237s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-1aa01aee-f0a4-47e8-a910-2d86e7b34f79" released by "delete_volume" :: held 0.678s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created reservations ['819ef1b5-1c0e-4b23-9bd8-962c331d153c', '0380db58-697e-4967-b0ad-f66f3f6fb238', 'd332bb9f-dd34-49d0-8ee4-a3d0f34fede6', 'bbd5da6f-3bda-4954-be85-73ed21e05984'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:24 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:18:24 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:24 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.248s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:18:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Deleted volume successfully. Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0cb6b4b6-c235-4176-b4da-afed4d395cd2 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-1aa01aee-f0a4-47e8-a910-2d86e7b34f79-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-5a436068-ec8b-4d40-a3c4-7d94853b901e-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-5a436068-ec8b-4d40-a3c4-7d94853b901e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "cinder-quobyte-5a436068-ec8b-4d40-a3c4-7d94853b901e" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-5a436068-ec8b-4d40-a3c4-7d94853b901e" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[693bbf7c-e1d0-4a02-b485-3123e7e39723]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:18:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:25 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e Nov 03 17:18:25 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:25 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e" returned: 0 in 0.346s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:25 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e Nov 03 17:18:25 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:25 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5a436068-ec8b-4d40-a3c4-7d94853b901e" returned: 0 in 0.238s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-quobyte-5a436068-ec8b-4d40-a3c4-7d94853b901e" released by "delete_volume" :: held 0.623s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:25 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Created reservations ['8444e093-8677-475e-a8e5-c47a721c9eda', 'a5c1190a-6876-4ec3-8c23-c11a050d3421', 'edea654d-c7a7-4a24-b381-f773247c9d7d', 'aec9a5dc-dceb-4492-8c01-e6a32a125258'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:18:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:25 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:18:25 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:26 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.233s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:26 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:18:26 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Deleted volume successfully. Nov 03 17:18:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-eaefd060-694c-41ca-a4b0-110b43ccfc69 tempest-CreateVolumesFromSourceVolumeTest-1089112357 None] Lock "cinder-5a436068-ec8b-4d40-a3c4-7d94853b901e-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:18:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:29 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:18:29 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:30 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.259s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:18:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:18:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:18:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:18:35 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=40,cinder:UPDATE=68,cinder:INSERT=14,cinder:DELETE=7 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:18:36 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=44,cinder:UPDATE=64,cinder:DELETE=5,cinder:INSERT=16 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Flow 'volume_create_manager' (923dd2fc-4395-407c-b786-786535cbe1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf37ae5a-6c2c-485a-8fc0-2b54465a1b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf37ae5a-6c2c-485a-8fc0-2b54465a1b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1824217908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79e9c4f-bbb9-417e-82d4-513a4b785ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830858646fa45f9a69cca598f8861ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:48Z,use_quota=True,user_id='f15b295e389945fe9fc99f34d03e8ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2273f774-8924-428b-82ea-a68d3b6bedf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2273f774-8924-428b-82ea-a68d3b6bedf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5634d78a-dae8-40ba-a30f-ff964b874555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5634d78a-dae8-40ba-a30f-ff964b874555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b79e9c4f-bbb9-417e-82d4-513a4b785ade', 'volume_name': 'volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f399e6-15e8-4549-a1cd-1312da36e8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f399e6-15e8-4549-a1cd-1312da36e8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f092ac-9914-4292-ba7e-25608f2ffea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:48 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Volume b79e9c4f-bbb9-417e-82d4-513a4b785ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade', 'volume_size': 1} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1824217908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79e9c4f-bbb9-417e-82d4-513a4b785ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830858646fa45f9a69cca598f8861ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:48Z,use_quota=True,user_id='f15b295e389945fe9fc99f34d03e8ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Creating volume b79e9c4f-bbb9-417e-82d4-513a4b785ade {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:18:48 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:48 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade 1073741824 Nov 03 17:18:48 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:48 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade 1073741824" returned: 0 in 0.390s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:48 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade Nov 03 17:18:48 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:48 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade" returned: 0 in 0.228s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f092ac-9914-4292-ba7e-25608f2ffea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d922ac0b-626a-4f00-af4b-f16e917ed4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:48 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Volume volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade (b79e9c4f-bbb9-417e-82d4-513a4b785ade): created successfully Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d922ac0b-626a-4f00-af4b-f16e917ed4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Flow 'volume_create_manager' (923dd2fc-4395-407c-b786-786535cbe1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a8d9001b-a8b6-401e-956e-f8a30f7d2ce2 tempest-SnapshotDependencyTests-1273573123 None] Created volume successfully. Nov 03 17:18:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] Creating offline snapshot d953ea66-8101-4e16-8967-8036842aba88 of volume b79e9c4f-bbb9-417e-82d4-513a4b785ade {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:18:49 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee2e2cb-0f10-4f10-b208-2cb92833b22c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:18:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:49 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade Nov 03 17:18:49 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:49 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade" returned: 0 in 0.340s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:49 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 1G Nov 03 17:18:49 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:50 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 1G" returned: 0 in 0.366s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:50 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 Nov 03 17:18:50 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:50 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88" returned: 0 in 0.260s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:50 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 is being set with open permissions: ugo+rw Nov 03 17:18:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:50 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 Nov 03 17:18:50 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:50 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88" returned: 0 in 0.222s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:50 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.info Nov 03 17:18:50 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:50 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.info" returned: 0 in 0.233s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:50 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.info is being set with open permissions: ugo+rw Nov 03 17:18:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:50 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.info Nov 03 17:18:50 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:51 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.info" returned: 0 in 0.223s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.735s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:51 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5d09dfea-4d03-485e-aad1-9f4bf198815f tempest-SnapshotDependencyTests-1273573123 None] Create snapshot completed successfully Nov 03 17:18:51 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Flow 'volume_create_manager' (b903db95-ec62-4809-8dcc-35ca8392e443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de0eb3d-8dc5-4b55-9977-be44c3a958f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de0eb3d-8dc5-4b55-9977-be44c3a958f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470b9320-6932-46bf-8cd5-0bfac4f874e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1830858646fa45f9a69cca598f8861ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d953ea66-8101-4e16-8967-8036842aba88,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:18:52Z,use_quota=True,user_id='f15b295e389945fe9fc99f34d03e8ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2788e3-c221-4aad-a472-3a86bb352f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2788e3-c221-4aad-a472-3a86bb352f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e89ca4-4f94-4427-b457-2e4d1f84fc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e89ca4-4f94-4427-b457-2e4d1f84fc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '470b9320-6932-46bf-8cd5-0bfac4f874e3', 'volume_name': 'volume-470b9320-6932-46bf-8cd5-0bfac4f874e3', 'volume_size': 1, 'snapshot_id': 'd953ea66-8101-4e16-8967-8036842aba88'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a24c73-9972-40ae-9f16-9668c16e5257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a24c73-9972-40ae-9f16-9668c16e5257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102ad27a-1da5-4f98-8a30-6abd71b1c7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:52 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Volume 470b9320-6932-46bf-8cd5-0bfac4f874e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-470b9320-6932-46bf-8cd5-0bfac4f874e3', 'volume_size': 1, 'snapshot_id': 'd953ea66-8101-4e16-8967-8036842aba88'} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "cinder-quobyte-d953ea66-8101-4e16-8967-8036842aba88-470b9320-6932-46bf-8cd5-0bfac4f874e3" by "_create_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-d953ea66-8101-4e16-8967-8036842aba88-470b9320-6932-46bf-8cd5-0bfac4f874e3" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Creating volume 470b9320-6932-46bf-8cd5-0bfac4f874e3 from snapshot d953ea66-8101-4e16-8967-8036842aba88 {{(pid=86661) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "cinder-quobyte-470b9320-6932-46bf-8cd5-0bfac4f874e3" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-470b9320-6932-46bf-8cd5-0bfac4f874e3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] snapshot: d953ea66-8101-4e16-8967-8036842aba88, volume: 470b9320-6932-46bf-8cd5-0bfac4f874e3, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bc2f1a-8f20-4f28-b694-72d0519e370a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:52 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 Nov 03 17:18:52 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:52 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88" returned: 0 in 0.337s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3daafc9-3df3-479d-bcc9-dc990bb006a8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:52 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade Nov 03 17:18:52 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:52 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade" returned: 0 in 0.355s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:18:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:52 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 Nov 03 17:18:52 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:58 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3" returned: 0 in 5.389s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:58 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:18:58 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Converted 1024.00 MB image at 189.96 MB/s Nov 03 17:18:58 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 is being set with open permissions: ugo+rw Nov 03 17:18:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:58 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 Nov 03 17:18:58 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:58 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3" returned: 0 in 0.235s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-470b9320-6932-46bf-8cd5-0bfac4f874e3" released by "_copy_volume_from_snapshot" :: held 6.398s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-d953ea66-8101-4e16-8967-8036842aba88-470b9320-6932-46bf-8cd5-0bfac4f874e3" released by "_create_volume_from_snapshot" :: held 6.463s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:18:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.481s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:18:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102ad27a-1da5-4f98-8a30-6abd71b1c7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470b9320-6932-46bf-8cd5-0bfac4f874e3', 'volume_size': 1, 'snapshot_id': 'd953ea66-8101-4e16-8967-8036842aba88'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bed0a04-6c67-415f-a318-6b9f95d4f2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:18:58 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Volume volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 (470b9320-6932-46bf-8cd5-0bfac4f874e3): created successfully Nov 03 17:18:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bed0a04-6c67-415f-a318-6b9f95d4f2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:18:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Flow 'volume_create_manager' (b903db95-ec62-4809-8dcc-35ca8392e443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:18:58 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7f552843-e48d-489e-820b-266ed53607b1 tempest-SnapshotDependencyTests-1273573123 None] Created volume successfully. Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "cinder-d953ea66-8101-4e16-8967-8036842aba88-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-d953ea66-8101-4e16-8967-8036842aba88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "cinder-quobyte-b79e9c4f-bbb9-417e-82d4-513a4b785ade" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-b79e9c4f-bbb9-417e-82d4-513a4b785ade" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "cinder-quobyte-d953ea66-8101-4e16-8967-8036842aba88" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-d953ea66-8101-4e16-8967-8036842aba88" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Deleting offline snapshot d953ea66-8101-4e16-8967-8036842aba88 of volume b79e9c4f-bbb9-417e-82d4-513a4b785ade {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] snapshot_file for this snap is: volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a28e1b3-d78e-4332-8898-09a1261eb541]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:18:59 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 Nov 03 17:18:59 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:18:59 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88" returned: 0 in 0.386s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:18:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:19:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbdd6e6-b017-42d8-9533-9bc50a1f5817]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:00 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade Nov 03 17:19:00 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:00 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade" returned: 0 in 0.531s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:00 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 Nov 03 17:19:00 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:00 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88" returned: 0 in 0.342s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:00 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88 Nov 03 17:19:00 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:01 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade.d953ea66-8101-4e16-8967-8036842aba88" returned: 0 in 0.238s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-d953ea66-8101-4e16-8967-8036842aba88" released by "_delete_snapshot" :: held 1.602s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-b79e9c4f-bbb9-417e-82d4-513a4b785ade" released by "delete_snapshot" :: held 1.625s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:01 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Created reservations ['118107d7-2f25-4043-bea5-cf8ac7f3bc41', 'a167ce9b-5c9a-4e01-ad4f-250110e8d154', 'c2647feb-8e7c-40cf-8ef7-4fcd5276bd1f', 'd7c65afb-e06c-49e7-88d5-bff744187a1c'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:01 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Delete snapshot completed successfully. Nov 03 17:19:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7aee5fea-d708-4319-a671-8223fb2b2322 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-d953ea66-8101-4e16-8967-8036842aba88-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "cinder-b79e9c4f-bbb9-417e-82d4-513a4b785ade-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-b79e9c4f-bbb9-417e-82d4-513a4b785ade-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "cinder-quobyte-b79e9c4f-bbb9-417e-82d4-513a4b785ade" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-b79e9c4f-bbb9-417e-82d4-513a4b785ade" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:01 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddbe792-3e27-491e-9d40-9509cfb60368]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:02 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade Nov 03 17:19:02 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:02 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade" returned: 0 in 0.420s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:02 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade Nov 03 17:19:02 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:02 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b79e9c4f-bbb9-417e-82d4-513a4b785ade" returned: 0 in 0.257s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-b79e9c4f-bbb9-417e-82d4-513a4b785ade" released by "delete_volume" :: held 0.747s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Created reservations ['1bc0f9d2-9e44-4d7b-a507-c37388d98e08', '30e30343-17c4-4d3a-9b64-c541d41f240e', 'a6fc616f-9611-4ce1-a424-7a93204c264a', '184728d8-4acf-46e7-aeaf-d71fe713b2d1'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:02 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:02 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "cinder-470b9320-6932-46bf-8cd5-0bfac4f874e3-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-470b9320-6932-46bf-8cd5-0bfac4f874e3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "cinder-quobyte-470b9320-6932-46bf-8cd5-0bfac4f874e3" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-470b9320-6932-46bf-8cd5-0bfac4f874e3" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7759cb4-db7c-454a-83eb-2df62e50195d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:03 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.305s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:03 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Deleted volume successfully. Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b54d1ff7-2ec8-4b4f-9dc6-773bb9fb5685 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-b79e9c4f-bbb9-417e-82d4-513a4b785ade-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:03 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 Nov 03 17:19:03 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:03 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3" returned: 0 in 0.364s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:03 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3 Nov 03 17:19:03 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:03 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-470b9320-6932-46bf-8cd5-0bfac4f874e3" returned: 0 in 0.239s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-quobyte-470b9320-6932-46bf-8cd5-0bfac4f874e3" released by "delete_volume" :: held 0.661s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Created reservations ['def97e0b-7b9e-4a43-8d9d-e664181a1eab', 'd889ac5d-6155-45df-bcf1-bd76855faae3', '290efecb-721e-44ae-8450-e419b4d80950', 'b6d4ad02-888e-4791-bc1a-67ef6999e754'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:03 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:03 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:03 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.240s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:04 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Deleted volume successfully. Nov 03 17:19:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ef4f955f-3020-483f-be52-a2f450756128 tempest-SnapshotDependencyTests-1273573123 None] Lock "cinder-470b9320-6932-46bf-8cd5-0bfac4f874e3-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:13 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=20,cinder:INSERT=9,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:19:14 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=24,cinder:SELECT=30,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:19:24 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (d86a41d5-ec0c-4ce4-b8b5-0d4ebd773e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:24 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68926a54-7b46-406d-8ab5-62170043bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68926a54-7b46-406d-8ab5-62170043bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556746076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f6278a-b73f-4568-930b-1719f850a52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:25Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137bb3b2-d89a-49e5-8eab-a6e3e2bb17dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137bb3b2-d89a-49e5-8eab-a6e3e2bb17dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432cce24-883e-4123-bc3a-ee96c7b8d993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432cce24-883e-4123-bc3a-ee96c7b8d993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f6278a-b73f-4568-930b-1719f850a52b', 'volume_name': 'volume-94f6278a-b73f-4568-930b-1719f850a52b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a021b1-5e9d-4da7-96ef-4a3d112f6421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a021b1-5e9d-4da7-96ef-4a3d112f6421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f346f5b-3af0-4315-a8b4-527f232ee097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume 94f6278a-b73f-4568-930b-1719f850a52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f6278a-b73f-4568-930b-1719f850a52b', 'volume_size': 1} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556746076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f6278a-b73f-4568-930b-1719f850a52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:25Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Creating volume 94f6278a-b73f-4568-930b-1719f850a52b {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:25 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:25 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b 1073741824 Nov 03 17:19:25 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (ab12f31b-c1eb-4e9c-9688-82c3db906dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2df894-eda7-48df-9c1b-5fdaac72fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2df894-eda7-48df-9c1b-5fdaac72fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-125629870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4589c5f-4d9b-4e62-8524-d50c774cde61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:25Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db649a55-30e6-4994-a33c-f8a3705cbc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db649a55-30e6-4994-a33c-f8a3705cbc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12248803-db0d-42bd-bb70-2479bfcf6527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12248803-db0d-42bd-bb70-2479bfcf6527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4589c5f-4d9b-4e62-8524-d50c774cde61', 'volume_name': 'volume-e4589c5f-4d9b-4e62-8524-d50c774cde61', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20694d6-3e37-49b5-a3ac-947267066440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20694d6-3e37-49b5-a3ac-947267066440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70ce53a-2919-4c21-8498-9e08e76ceede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume e4589c5f-4d9b-4e62-8524-d50c774cde61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4589c5f-4d9b-4e62-8524-d50c774cde61', 'volume_size': 1} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:25 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b 1073741824" returned: 0 in 0.606s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:25 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b Nov 03 17:19:25 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Flow 'volume_create_manager' (ecc97d2b-ce4e-4020-9c1a-a16a257144c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e36f95-99dc-41e2-a4cc-6372f33cabab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e36f95-99dc-41e2-a4cc-6372f33cabab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360101114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef39b0c2-ad2b-4841-b892-17d620d36f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2aca5e5bd483ab7e1d5680b79c1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:26Z,use_quota=True,user_id='50d7739ba9c140428b1573df09d7e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35033374-3665-4a43-91ac-b232fddae9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35033374-3665-4a43-91ac-b232fddae9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d54bf7b-cc91-4668-a898-d87cf1c0af96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d54bf7b-cc91-4668-a898-d87cf1c0af96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef39b0c2-ad2b-4841-b892-17d620d36f44', 'volume_name': 'volume-ef39b0c2-ad2b-4841-b892-17d620d36f44', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1fa3f0-316c-4ebc-878a-890747f2e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1fa3f0-316c-4ebc-878a-890747f2e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852032a8-d3ad-446c-a5fd-6765b618936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:25 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Volume ef39b0c2-ad2b-4841-b892-17d620d36f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef39b0c2-ad2b-4841-b892-17d620d36f44', 'volume_size': 1} Nov 03 17:19:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:26 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b" returned: 0 in 0.310s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-125629870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4589c5f-4d9b-4e62-8524-d50c774cde61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:25Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Creating volume e4589c5f-4d9b-4e62-8524-d50c774cde61 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:26 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:26 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61 1073741824 Nov 03 17:19:26 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f346f5b-3af0-4315-a8b4-527f232ee097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f6278a-b73f-4568-930b-1719f850a52b', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5b6293-91e6-46e1-96c4-dc8ec5aae1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:26 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume volume-94f6278a-b73f-4568-930b-1719f850a52b (94f6278a-b73f-4568-930b-1719f850a52b): created successfully Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5b6293-91e6-46e1-96c4-dc8ec5aae1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (d86a41d5-ec0c-4ce4-b8b5-0d4ebd773e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:26 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-bf2a3e55-027d-43a9-be61-96d2f18bd195 tempest-CreateVolumesFromSnapshotTest-650814363 None] Created volume successfully. Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Flow 'volume_create_manager' (ebaaea94-38d4-4a6f-9ecf-107f9f6507e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387bf843-597a-44cf-8b3a-8bff019eb418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387bf843-597a-44cf-8b3a-8bff019eb418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392050262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40625138-23ec-4c44-b558-e2842da35ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2aca5e5bd483ab7e1d5680b79c1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:26Z,use_quota=True,user_id='50d7739ba9c140428b1573df09d7e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc2228e-2d68-41e7-a1c3-5b3d13bef40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc2228e-2d68-41e7-a1c3-5b3d13bef40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afe97c4-6b25-421b-ae58-93e0ba5a8ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afe97c4-6b25-421b-ae58-93e0ba5a8ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40625138-23ec-4c44-b558-e2842da35ce0', 'volume_name': 'volume-40625138-23ec-4c44-b558-e2842da35ce0', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03036c03-68be-4cb7-a471-a14035c4a0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03036c03-68be-4cb7-a471-a14035c4a0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa705ede-aa96-4e19-a64f-1d2efa0ce770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:26 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Volume 40625138-23ec-4c44-b558-e2842da35ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40625138-23ec-4c44-b558-e2842da35ce0', 'volume_size': 1} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:26 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61 1073741824" returned: 0 in 0.611s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:26 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61 Nov 03 17:19:26 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Flow 'volume_create_manager' (902a281e-d90f-4702-8fb4-9ec08942a403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dbd846-1b5e-42b6-8dde-1e6bdde29345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dbd846-1b5e-42b6-8dde-1e6bdde29345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1673626863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1504225e-b9f1-478f-8e57-a2c0ecfbf374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2aca5e5bd483ab7e1d5680b79c1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:27Z,use_quota=True,user_id='50d7739ba9c140428b1573df09d7e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29b780e-f42c-4fa3-ac18-f93a4dced60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29b780e-f42c-4fa3-ac18-f93a4dced60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d0f5a1-f463-4510-baa1-b07fe795c719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d0f5a1-f463-4510-baa1-b07fe795c719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1504225e-b9f1-478f-8e57-a2c0ecfbf374', 'volume_name': 'volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739f5e89-464b-495e-9b84-116a40531fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:27 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739f5e89-464b-495e-9b84-116a40531fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543117e9-cd9d-4b47-a52a-441e61f79535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:27 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Volume 1504225e-b9f1-478f-8e57-a2c0ecfbf374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374', 'volume_size': 1} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61" returned: 0 in 0.286s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.059s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360101114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef39b0c2-ad2b-4841-b892-17d620d36f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2aca5e5bd483ab7e1d5680b79c1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:26Z,use_quota=True,user_id='50d7739ba9c140428b1573df09d7e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Creating volume ef39b0c2-ad2b-4841-b892-17d620d36f44 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:27 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70ce53a-2919-4c21-8498-9e08e76ceede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4589c5f-4d9b-4e62-8524-d50c774cde61', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:27 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44 1073741824 Nov 03 17:19:27 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93140d9c-b951-46ca-80d7-f626328db431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:27 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume volume-e4589c5f-4d9b-4e62-8524-d50c774cde61 (e4589c5f-4d9b-4e62-8524-d50c774cde61): created successfully Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93140d9c-b951-46ca-80d7-f626328db431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (ab12f31b-c1eb-4e9c-9688-82c3db906dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-36d46594-0a05-4e76-ad1b-b2909d87720f tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created volume successfully. Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Flow 'volume_create_manager' (63aec6c6-5ab5-4b59-b770-2e4b4e31792f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e6b076-1d53-4c92-a6af-21900b5f075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e6b076-1d53-4c92-a6af-21900b5f075e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1639627396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5372a88d-2f49-4e86-b2aa-e4f211b89a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2aca5e5bd483ab7e1d5680b79c1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:27Z,use_quota=True,user_id='50d7739ba9c140428b1573df09d7e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e458d5-d389-44c8-84ca-7030975eed4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e458d5-d389-44c8-84ca-7030975eed4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577d6d72-dd49-4796-a612-0253c9e93b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577d6d72-dd49-4796-a612-0253c9e93b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5372a88d-2f49-4e86-b2aa-e4f211b89a26', 'volume_name': 'volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb2a06b-3d93-47ae-9297-b0fea55acf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb2a06b-3d93-47ae-9297-b0fea55acf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c469f41-b94d-476e-b0c6-11bed912c4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:27 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Volume 5372a88d-2f49-4e86-b2aa-e4f211b89a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26', 'volume_size': 1} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:27 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44 1073741824" returned: 0 in 0.801s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:27 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44 Nov 03 17:19:27 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Flow 'volume_create_manager' (5a7e1f58-c36f-4e40-a0aa-ec9b4504f4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d55919e-53e5-42f1-b9ec-082eb75839b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d55919e-53e5-42f1-b9ec-082eb75839b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436252833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550212ac-d7cb-4c18-b2ce-c82bc42e02ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2aca5e5bd483ab7e1d5680b79c1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:28Z,use_quota=True,user_id='50d7739ba9c140428b1573df09d7e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eeea96e-4d10-4f59-bffb-b387a8d0b7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eeea96e-4d10-4f59-bffb-b387a8d0b7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fcf9fe-ed69-4caa-94c4-82bf29356e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fcf9fe-ed69-4caa-94c4-82bf29356e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '550212ac-d7cb-4c18-b2ce-c82bc42e02ce', 'volume_name': 'volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fbfe33-48a9-42e3-b2a9-71ee2276e415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fbfe33-48a9-42e3-b2a9-71ee2276e415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6daafb70-af2d-420f-9381-20d793127466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Volume 550212ac-d7cb-4c18-b2ce-c82bc42e02ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce', 'volume_size': 1} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:28 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44" returned: 0 in 0.303s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.681s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392050262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40625138-23ec-4c44-b558-e2842da35ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2aca5e5bd483ab7e1d5680b79c1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:26Z,use_quota=True,user_id='50d7739ba9c140428b1573df09d7e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Creating volume 40625138-23ec-4c44-b558-e2842da35ce0 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:28 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852032a8-d3ad-446c-a5fd-6765b618936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef39b0c2-ad2b-4841-b892-17d620d36f44', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6491beaf-6186-47c1-94a1-8a7474d9177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0 1073741824 Nov 03 17:19:28 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:28 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Volume volume-ef39b0c2-ad2b-4841-b892-17d620d36f44 (ef39b0c2-ad2b-4841-b892-17d620d36f44): created successfully Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6491beaf-6186-47c1-94a1-8a7474d9177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Flow 'volume_create_manager' (ecc97d2b-ce4e-4020-9c1a-a16a257144c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:28 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3ab4cef3-4f3f-40de-97ef-f93059369e23 tempest-CreateVolumesFromImageTest-2072174413 None] Created volume successfully. Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (90475afd-662b-4622-85fd-011c3f043d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07c837e-5d3e-4110-a00d-b68200c66414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07c837e-5d3e-4110-a00d-b68200c66414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1485205284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a277f6-7358-4936-9960-2a14399a7279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:28Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781a845d-26d2-419a-b2ec-879e26d54412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781a845d-26d2-419a-b2ec-879e26d54412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83855abf-f7ff-42e4-981c-d880e0f3c8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83855abf-f7ff-42e4-981c-d880e0f3c8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a277f6-7358-4936-9960-2a14399a7279', 'volume_name': 'volume-39a277f6-7358-4936-9960-2a14399a7279', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109d1c16-2691-4f5a-9801-1d59a78cd326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109d1c16-2691-4f5a-9801-1d59a78cd326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450e0f44-9fc5-43f0-9779-8451bb1971bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume 39a277f6-7358-4936-9960-2a14399a7279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a277f6-7358-4936-9960-2a14399a7279', 'volume_size': 1} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (eb03a9eb-7a81-4f24-9d5f-61ef12e42889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b5354f-d589-44f8-8afb-16ee646ec4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0 1073741824" returned: 0 in 0.668s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b5354f-d589-44f8-8afb-16ee646ec4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-724257102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361bde25-76ea-49ab-9279-f098c3d93d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:29Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7930186-d3b3-4141-b94b-6278c00353a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7930186-d3b3-4141-b94b-6278c00353a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331aa617-d6e4-4d54-b164-03bf01efcfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331aa617-d6e4-4d54-b164-03bf01efcfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361bde25-76ea-49ab-9279-f098c3d93d74', 'volume_name': 'volume-361bde25-76ea-49ab-9279-f098c3d93d74', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1e4e01-0aaf-4260-8f0b-0776bff93e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1e4e01-0aaf-4260-8f0b-0776bff93e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a2cce6-66f1-4c79-a434-1b9b0062ac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:28 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume 361bde25-76ea-49ab-9279-f098c3d93d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361bde25-76ea-49ab-9279-f098c3d93d74', 'volume_size': 1} Nov 03 17:19:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:29 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0 Nov 03 17:19:29 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:29 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (13a9a03a-7e60-453f-b6f6-2107bd36e03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b21a4e4-96eb-443f-9aad-331f2b3b2365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0" returned: 0 in 0.407s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.400s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1673626863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1504225e-b9f1-478f-8e57-a2c0ecfbf374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2aca5e5bd483ab7e1d5680b79c1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:27Z,use_quota=True,user_id='50d7739ba9c140428b1573df09d7e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Creating volume 1504225e-b9f1-478f-8e57-a2c0ecfbf374 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:29 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b21a4e4-96eb-443f-9aad-331f2b3b2365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1275693580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd3b4ace-8249-4785-9d61-71e17fe57def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:29Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5a816a-c650-4533-a2c7-2565919d4fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5a816a-c650-4533-a2c7-2565919d4fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374 1073741824 Nov 03 17:19:29 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256155fd-6836-44c4-b472-5a71cfb7bf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256155fd-6836-44c4-b472-5a71cfb7bf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd3b4ace-8249-4785-9d61-71e17fe57def', 'volume_name': 'volume-bd3b4ace-8249-4785-9d61-71e17fe57def', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4cf1d5-b1d3-4b48-8965-a5544ef4706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4cf1d5-b1d3-4b48-8965-a5544ef4706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e623a61d-dfe8-4f23-a263-c5c5fe250f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume bd3b4ace-8249-4785-9d61-71e17fe57def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd3b4ace-8249-4785-9d61-71e17fe57def', 'volume_size': 1} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa705ede-aa96-4e19-a64f-1d2efa0ce770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40625138-23ec-4c44-b558-e2842da35ce0', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa12179f-211d-4708-9f3e-5d286b68ebb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Volume volume-40625138-23ec-4c44-b558-e2842da35ce0 (40625138-23ec-4c44-b558-e2842da35ce0): created successfully Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa12179f-211d-4708-9f3e-5d286b68ebb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Flow 'volume_create_manager' (ebaaea94-38d4-4a6f-9ecf-107f9f6507e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Flow 'volume_create_manager' (bd13dc90-3933-4fa7-b8ec-045426dec38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65251d8-e441-4fd6-9416-fb6bd508226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-db0bdc76-11fe-40f8-8e05-32c5cbd32cf6 tempest-CreateVolumesFromImageTest-2072174413 None] Created volume successfully. Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65251d8-e441-4fd6-9416-fb6bd508226e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f01d2e-f65e-4887-94c9-ae014b13daca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198bc1e28ab74d4788bdd02198b33de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:29Z,use_quota=True,user_id='5495f67c4d1045eea3a5ebdf227db5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57a644ae-ad5d-4cb3-98c4-e8cc3536873b),volume_type_id=57a644ae-ad5d-4cb3-98c4-e8cc3536873b)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc9e221-f14e-493f-8d2e-b5bfe7b8aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc9e221-f14e-493f-8d2e-b5bfe7b8aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6ce644-4540-40e1-8483-a0089db9c6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.image.glance [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Creating Keystone auth plugin from conf {{(pid=86661) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:29 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:29 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (ff8a6c4a-3ec9-480b-9f31-8255fe8479d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b119d287-aaed-45c0-b21b-f7b826783f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b119d287-aaed-45c0-b21b-f7b826783f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178925865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a14993-ac09-414d-9dbf-c34a48c19955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:30Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a121842d-5be1-46db-b771-5d3a7c1d66ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a121842d-5be1-46db-b771-5d3a7c1d66ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b464c1-4ca2-403b-888b-3be079fcef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62b464c1-4ca2-403b-888b-3be079fcef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a14993-ac09-414d-9dbf-c34a48c19955', 'volume_name': 'volume-38a14993-ac09-414d-9dbf-c34a48c19955', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fe8257-6b1f-49f8-bad0-a9a7e683ebfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fe8257-6b1f-49f8-bad0-a9a7e683ebfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5684a7b-c133-4344-8d27-8427b59fb3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:29 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume 38a14993-ac09-414d-9dbf-c34a48c19955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a14993-ac09-414d-9dbf-c34a48c19955', 'volume_size': 1} Nov 03 17:19:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6ce644-4540-40e1-8483-a0089db9c6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '08f01d2e-f65e-4887-94c9-ae014b13daca', 'volume_name': 'volume-08f01d2e-f65e-4887-94c9-ae014b13daca', 'volume_size': 1, 'image_id': '42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '67256ca69121496f20465449a45eefe6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '198bc1e28ab74d4788bdd02198b33de9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1ba77c4712f6c4d2d1052689d17895408f2993b704564e9105a89e78d38210f0867bc0633e2a2ccf78b59b480cb8dcd6e87720569e5c42745d53246fe251a021', 'id': '42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'created_at': datetime.datetime(2026, 11, 3, 16, 19, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 19, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42a84dd8-96a8-4388-8ca8-08ff398cf43c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1b3993-f41e-4cb3-b682-ca7bed770bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1b3993-f41e-4cb3-b682-ca7bed770bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6730c5a-05d0-4a0b-8a85-0718d8047080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:30 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Volume 08f01d2e-f65e-4887-94c9-ae014b13daca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-08f01d2e-f65e-4887-94c9-ae014b13daca', 'volume_size': 1, 'image_id': '42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '67256ca69121496f20465449a45eefe6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '198bc1e28ab74d4788bdd02198b33de9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1ba77c4712f6c4d2d1052689d17895408f2993b704564e9105a89e78d38210f0867bc0633e2a2ccf78b59b480cb8dcd6e87720569e5c42745d53246fe251a021', 'id': '42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'created_at': datetime.datetime(2026, 11, 3, 16, 19, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 19, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42a84dd8-96a8-4388-8ca8-08ff398cf43c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Trying to clone 08f01d2e-f65e-4887-94c9-ae014b13daca from image 42a84dd8-96a8-4388-8ca8-08ff398cf43c at location (None, [{'url': 'file:///opt/stack/data/glance/images/42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'metadata': {}}]). {{(pid=86661) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:19:30 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374 1073741824" returned: 0 in 0.720s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:30 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.403s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:19:30 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:19:30 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374 Nov 03 17:19:30 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[906230c6-c128-4aca-b7e2-c4f49456e245]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (df98f576-7f97-49bc-8278-65ec613727a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee9b3e3-ba29-466a-b15c-0c6847409059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee9b3e3-ba29-466a-b15c-0c6847409059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091888723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b34197-cd92-411d-8a58-84cd7fca3242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:30Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ee5a20-b112-43ca-bcf8-01d4ec71f7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ee5a20-b112-43ca-bcf8-01d4ec71f7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22db167-16dc-4f09-b44b-1932eb443e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22db167-16dc-4f09-b44b-1932eb443e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b34197-cd92-411d-8a58-84cd7fca3242', 'volume_name': 'volume-a8b34197-cd92-411d-8a58-84cd7fca3242', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514ac976-15ad-453e-bb13-242e178d4e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514ac976-15ad-453e-bb13-242e178d4e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a0d032-f929-44a2-b036-805da4e658ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:30 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume a8b34197-cd92-411d-8a58-84cd7fca3242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b34197-cd92-411d-8a58-84cd7fca3242', 'volume_size': 1} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:30 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD Nov 03 17:19:30 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:30 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374" returned: 0 in 0.264s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.989s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1639627396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5372a88d-2f49-4e86-b2aa-e4f211b89a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2aca5e5bd483ab7e1d5680b79c1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:27Z,use_quota=True,user_id='50d7739ba9c140428b1573df09d7e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Creating volume 5372a88d-2f49-4e86-b2aa-e4f211b89a26 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:30 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:30 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26 1073741824 Nov 03 17:19:30 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543117e9-cd9d-4b47-a52a-441e61f79535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80da1cea-06bc-437b-ad20-65a3fd38bc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:30 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Volume volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374 (1504225e-b9f1-478f-8e57-a2c0ecfbf374): created successfully Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80da1cea-06bc-437b-ad20-65a3fd38bc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Flow 'volume_create_manager' (902a281e-d90f-4702-8fb4-9ec08942a403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-952ad4eb-0daf-4293-b1bb-1dec8b5f3487 tempest-CreateVolumesFromImageTest-2072174413 None] Created volume successfully. Nov 03 17:19:30 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:30 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD Nov 03 17:19:30 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:30 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26 1073741824" returned: 0 in 0.414s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:30 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD" returned: 1 in 0.329s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:19:30 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Temporary image 42a84dd8-96a8-4388-8ca8-08ff398cf43c is fetched for user 5495f67c4d1045eea3a5ebdf227db5ac. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:19:30 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26 Nov 03 17:19:30 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[45194524-36f5-4d6f-9a77-a9c0319fa140]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:31 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD Nov 03 17:19:31 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:31 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26" returned: 0 in 0.256s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.552s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c469f41-b94d-476e-b0c6-11bed912c4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fea611-7259-4a0c-97be-e6ce4872af8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] Creating offline snapshot c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 of volume 94f6278a-b73f-4568-930b-1719f850a52b {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:19:31 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Volume volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26 (5372a88d-2f49-4e86-b2aa-e4f211b89a26): created successfully Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fea611-7259-4a0c-97be-e6ce4872af8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Flow 'volume_create_manager' (63aec6c6-5ab5-4b59-b770-2e4b4e31792f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cafc7c-88b2-4a9f-8562-fb5c5c5c0b4b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:31 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-afaa53d2-8b77-4e58-a25b-0aed8e0ac07c tempest-CreateVolumesFromImageTest-2072174413 None] Created volume successfully. Nov 03 17:19:31 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:31 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b Nov 03 17:19:31 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:31 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD Nov 03 17:19:31 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:31 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b" returned: 0 in 0.434s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:31 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD" returned: 1 in 0.332s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:19:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:31 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 1G Nov 03 17:19:31 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:32 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 1G" returned: 0 in 0.377s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f6278a-b73f-4568-930b-1719f850a52b -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:32 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f6278a-b73f-4568-930b-1719f850a52b -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 Nov 03 17:19:32 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:32 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f6278a-b73f-4568-930b-1719f850a52b -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5" returned: 0 in 0.281s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:32 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 is being set with open permissions: ugo+rw Nov 03 17:19:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:32 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 Nov 03 17:19:32 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:32 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5" returned: 0 in 0.247s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:32 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.info Nov 03 17:19:32 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:32 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.info" returned: 0 in 0.258s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:32 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.info is being set with open permissions: ugo+rw Nov 03 17:19:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:32 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.info Nov 03 17:19:32 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:33 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.info" returned: 0 in 0.231s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.114s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436252833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550212ac-d7cb-4c18-b2ce-c82bc42e02ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2aca5e5bd483ab7e1d5680b79c1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:28Z,use_quota=True,user_id='50d7739ba9c140428b1573df09d7e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Creating volume 550212ac-d7cb-4c18-b2ce-c82bc42e02ce {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:33 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:33 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce 1073741824 Nov 03 17:19:33 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e6be5398-45fe-40e2-a003-8a45c2cbafde tempest-CreateVolumesFromSnapshotTest-650814363 None] Create snapshot completed successfully Nov 03 17:19:33 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce 1073741824" returned: 0 in 0.431s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:33 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce Nov 03 17:19:33 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:33 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce" returned: 0 in 0.248s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.423s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1485205284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a277f6-7358-4936-9960-2a14399a7279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:28Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Creating volume 39a277f6-7358-4936-9960-2a14399a7279 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:33 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6daafb70-af2d-420f-9381-20d793127466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b176807-2e1a-41af-9f80-d18737136344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:33 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279 1073741824 Nov 03 17:19:33 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:33 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Volume volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce (550212ac-d7cb-4c18-b2ce-c82bc42e02ce): created successfully Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b176807-2e1a-41af-9f80-d18737136344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:33 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Flow 'volume_create_manager' (5a7e1f58-c36f-4e40-a0aa-ec9b4504f4ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:34 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a72af240-d8f0-4734-8d2b-c9c7bf507b52 tempest-CreateVolumesFromImageTest-2072174413 None] Created volume successfully. Nov 03 17:19:34 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279 1073741824" returned: 0 in 0.435s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:34 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279 Nov 03 17:19:34 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:34 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279" returned: 0 in 0.307s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.746s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-724257102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361bde25-76ea-49ab-9279-f098c3d93d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:29Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Creating volume 361bde25-76ea-49ab-9279-f098c3d93d74 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:34 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450e0f44-9fc5-43f0-9779-8451bb1971bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a277f6-7358-4936-9960-2a14399a7279', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:34 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74 1073741824 Nov 03 17:19:34 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7ac584-c483-4e49-9e5e-0df34eead93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:34 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume volume-39a277f6-7358-4936-9960-2a14399a7279 (39a277f6-7358-4936-9960-2a14399a7279): created successfully Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7ac584-c483-4e49-9e5e-0df34eead93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (90475afd-662b-4622-85fd-011c3f043d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:34 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-20858633-8243-43ca-be8c-516f1d7d572c tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created volume successfully. Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (c66258be-cd9a-429c-bdb1-becb68638f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602ca56c-a005-442a-a912-7f861264477b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602ca56c-a005-442a-a912-7f861264477b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1446830872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a770797d-8a44-405f-b184-c59d33e1340c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:35Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9827ab31-72ef-4e6c-9bf4-3794acef5184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9827ab31-72ef-4e6c-9bf4-3794acef5184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbedd9f-9a97-4dc7-943d-0dda35c2cb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbedd9f-9a97-4dc7-943d-0dda35c2cb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a770797d-8a44-405f-b184-c59d33e1340c', 'volume_name': 'volume-a770797d-8a44-405f-b184-c59d33e1340c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f7d5a4-6297-4eae-9532-a46c65b84136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f7d5a4-6297-4eae-9532-a46c65b84136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec1ce2e-086c-4da2-a14a-8034a18013be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:35 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume a770797d-8a44-405f-b184-c59d33e1340c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a770797d-8a44-405f-b184-c59d33e1340c', 'volume_size': 1} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "cinder-550212ac-d7cb-4c18-b2ce-c82bc42e02ce-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-550212ac-d7cb-4c18-b2ce-c82bc42e02ce-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "cinder-quobyte-550212ac-d7cb-4c18-b2ce-c82bc42e02ce" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-quobyte-550212ac-d7cb-4c18-b2ce-c82bc42e02ce" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98b6c1b-205d-40b4-97b2-4a792b92df0e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:35 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce Nov 03 17:19:35 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (13fca563-839b-42ce-9d45-fa6082477bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53a887f-edb8-4faa-8cde-ac21c27ceb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53a887f-edb8-4faa-8cde-ac21c27ceb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-416617385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95af8aba-1670-428c-9ec1-cd2c8a73fc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:35Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dfa7f9-3749-4f24-ad8e-e47e5a968ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dfa7f9-3749-4f24-ad8e-e47e5a968ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f99e10-1e46-4a1e-9894-929505f62ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f99e10-1e46-4a1e-9894-929505f62ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95af8aba-1670-428c-9ec1-cd2c8a73fc4d', 'volume_name': 'volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a4568f-dae8-4acc-abe7-99d84083df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:35 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a4568f-dae8-4acc-abe7-99d84083df39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ccbde8-dd43-49a1-971b-763a265fad43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:35 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume 95af8aba-1670-428c-9ec1-cd2c8a73fc4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d', 'volume_size': 1} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74 1073741824" returned: 0 in 0.749s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:35 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74 Nov 03 17:19:35 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:35 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce" returned: 0 in 0.499s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:35 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce Nov 03 17:19:35 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:35 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (dbb189fc-d0f2-4e66-bab6-a9bddfd86ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d619bfdc-e7ca-44d0-8d1d-84674ca96d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74" returned: 0 in 0.417s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.453s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1275693580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd3b4ace-8249-4785-9d61-71e17fe57def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:29Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Creating volume bd3b4ace-8249-4785-9d61-71e17fe57def {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:35 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d619bfdc-e7ca-44d0-8d1d-84674ca96d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1562925561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a27d7b-4cf3-4923-a86a-de34fe5edf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:36Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def 1073741824 Nov 03 17:19:36 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512f6566-a938-4c94-a2a8-9069437a7e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512f6566-a938-4c94-a2a8-9069437a7e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027d87c8-d003-420a-8990-7d6b91cef3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027d87c8-d003-420a-8990-7d6b91cef3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a27d7b-4cf3-4923-a86a-de34fe5edf8c', 'volume_name': 'volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ab68ce-ddba-4f62-9510-a93f323d1c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ab68ce-ddba-4f62-9510-a93f323d1c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a28af4-a45e-48e9-81e5-c1d51556c502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume 44a27d7b-4cf3-4923-a86a-de34fe5edf8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c', 'volume_size': 1} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a2cce6-66f1-4c79-a434-1b9b0062ac93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361bde25-76ea-49ab-9279-f098c3d93d74', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f3881a-7894-466c-8d05-7ec60b6db3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-550212ac-d7cb-4c18-b2ce-c82bc42e02ce" returned: 0 in 0.358s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:36 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume volume-361bde25-76ea-49ab-9279-f098c3d93d74 (361bde25-76ea-49ab-9279-f098c3d93d74): created successfully Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f3881a-7894-466c-8d05-7ec60b6db3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (eb03a9eb-7a81-4f24-9d5f-61ef12e42889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-quobyte-550212ac-d7cb-4c18-b2ce-c82bc42e02ce" released by "delete_volume" :: held 0.947s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6798ec3b-d34d-419c-93c1-4f9deb4b60ab tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created volume successfully. Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Created reservations ['c3391a00-1a99-4ec4-8ddb-db6eedb227d6', '99fb4984-5c8f-4663-a5a8-980cbdfccfcc', '19a515ff-33cd-45b8-935d-23ea75864cd1', '7f610a85-28f8-407d-9e3a-c88838cd6ccd'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:36 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:36 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (2f67e971-fd1f-455f-915a-0fe6add16a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402e52fb-7663-4476-85b1-d52543aaabdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402e52fb-7663-4476-85b1-d52543aaabdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2058383243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ce29ba-a430-4236-8446-29edcde31b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:36Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbaa0af-2772-4852-99c6-c581b1066778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbaa0af-2772-4852-99c6-c581b1066778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b20a83-4266-4d90-8810-cdf653dc4adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b20a83-4266-4d90-8810-cdf653dc4adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ce29ba-a430-4236-8446-29edcde31b87', 'volume_name': 'volume-92ce29ba-a430-4236-8446-29edcde31b87', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9815b1f4-1c02-436c-8943-04f197f440ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9815b1f4-1c02-436c-8943-04f197f440ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e21c60-22b7-46c9-8b07-d36c94af802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume 92ce29ba-a430-4236-8446-29edcde31b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ce29ba-a430-4236-8446-29edcde31b87', 'volume_size': 1} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:36 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def 1073741824" returned: 0 in 0.606s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:36 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def Nov 03 17:19:36 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:36 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.348s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Deleted volume successfully. Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b9850fe0-c4f2-4059-83a5-4957ea429dfd tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-550212ac-d7cb-4c18-b2ce-c82bc42e02ce-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (d784c269-5801-48a8-8062-03b647440107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15c491b-c97b-449b-b697-cde0b2a7636e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15c491b-c97b-449b-b697-cde0b2a7636e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1591564060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d0ed98-8169-416e-8cd2-e988cedd7f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:37Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d304daa-4493-4b1d-b38c-d744123ce5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d304daa-4493-4b1d-b38c-d744123ce5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab0b2f3-efdf-48a1-9a82-868ea854074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab0b2f3-efdf-48a1-9a82-868ea854074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d0ed98-8169-416e-8cd2-e988cedd7f31', 'volume_name': 'volume-26d0ed98-8169-416e-8cd2-e988cedd7f31', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723c3832-b003-4cf1-b4a0-8a8f9ea3a401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723c3832-b003-4cf1-b4a0-8a8f9ea3a401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ee7e3a-bb3b-4ad1-b25c-91a4335e3100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume 26d0ed98-8169-416e-8cd2-e988cedd7f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d0ed98-8169-416e-8cd2-e988cedd7f31', 'volume_size': 1} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def" returned: 0 in 0.266s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.915s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178925865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a14993-ac09-414d-9dbf-c34a48c19955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:30Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Creating volume 38a14993-ac09-414d-9dbf-c34a48c19955 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:36 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e623a61d-dfe8-4f23-a263-c5c5fe250f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd3b4ace-8249-4785-9d61-71e17fe57def', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f58afa-32ee-47da-b657-58de4a83e934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:36 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955 1073741824 Nov 03 17:19:36 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:36 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume volume-bd3b4ace-8249-4785-9d61-71e17fe57def (bd3b4ace-8249-4785-9d61-71e17fe57def): created successfully Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f58afa-32ee-47da-b657-58de4a83e934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (13a9a03a-7e60-453f-b6f6-2107bd36e03f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-0fe25802-e4b7-4c76-a24e-4f3398d7e3dc tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created volume successfully. Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "cinder-5372a88d-2f49-4e86-b2aa-e4f211b89a26-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-5372a88d-2f49-4e86-b2aa-e4f211b89a26-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "cinder-quobyte-5372a88d-2f49-4e86-b2aa-e4f211b89a26" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-quobyte-5372a88d-2f49-4e86-b2aa-e4f211b89a26" acquired by "delete_volume" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec8537b-2bd7-4162-ae91-a1337ecf146a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:37 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955 1073741824" returned: 0 in 0.524s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:37 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955 Nov 03 17:19:37 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:37 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26 Nov 03 17:19:37 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:37 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955" returned: 0 in 0.288s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.357s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091888723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b34197-cd92-411d-8a58-84cd7fca3242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5af1d0e618b495ab9545e209f7e2a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:30Z,use_quota=True,user_id='e091e719a86646f986729feee393f01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Creating volume a8b34197-cd92-411d-8a58-84cd7fca3242 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:37 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:37 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26" returned: 0 in 0.375s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:37 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242 1073741824 Nov 03 17:19:37 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:37 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26 Nov 03 17:19:37 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5684a7b-c133-4344-8d27-8427b59fb3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a14993-ac09-414d-9dbf-c34a48c19955', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bbb5a8-62b2-4976-aefc-a010b2e2b1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:37 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume volume-38a14993-ac09-414d-9dbf-c34a48c19955 (38a14993-ac09-414d-9dbf-c34a48c19955): created successfully Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bbb5a8-62b2-4976-aefc-a010b2e2b1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (ff8a6c4a-3ec9-480b-9f31-8255fe8479d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:37 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-0f691b59-031a-4169-bd43-2868d044d16b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created volume successfully. Nov 03 17:19:38 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5372a88d-2f49-4e86-b2aa-e4f211b89a26" returned: 0 in 0.264s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-quobyte-5372a88d-2f49-4e86-b2aa-e4f211b89a26" released by "delete_volume" :: held 0.688s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Created reservations ['816e6d39-8cf9-4a54-bce4-6ea7c7cdea93', '30301e53-344d-41c1-bca6-1982388ffa1b', 'd1cf0da0-287e-4ac5-bf3c-0e1382742c9f', 'ba406a46-6f15-48e8-997f-05a7b7bf3425'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:38 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:38 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:38 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242 1073741824" returned: 0 in 0.533s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:38 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242 Nov 03 17:19:38 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "cinder-1504225e-b9f1-478f-8e57-a2c0ecfbf374-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-1504225e-b9f1-478f-8e57-a2c0ecfbf374-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:38 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.280s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:38 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Deleted volume successfully. Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "cinder-quobyte-1504225e-b9f1-478f-8e57-a2c0ecfbf374" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c274666f-a646-42c6-9c4d-5f35c2d3cb81 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-5372a88d-2f49-4e86-b2aa-e4f211b89a26-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-quobyte-1504225e-b9f1-478f-8e57-a2c0ecfbf374" acquired by "delete_volume" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5035d26b-1419-4200-82ec-9981a5e1c16e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:38 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242" returned: 0 in 0.300s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.922s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f01d2e-f65e-4887-94c9-ae014b13daca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198bc1e28ab74d4788bdd02198b33de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:29Z,use_quota=True,user_id='5495f67c4d1045eea3a5ebdf227db5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57a644ae-ad5d-4cb3-98c4-e8cc3536873b),volume_type_id=57a644ae-ad5d-4cb3-98c4-e8cc3536873b)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Creating volume 08f01d2e-f65e-4887-94c9-ae014b13daca {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:38 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:38 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca 1073741824 Nov 03 17:19:38 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a0d032-f929-44a2-b036-805da4e658ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b34197-cd92-411d-8a58-84cd7fca3242', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b513119-2a92-4154-b5d9-82acfd8b64ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:38 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374 Nov 03 17:19:38 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Volume volume-a8b34197-cd92-411d-8a58-84cd7fca3242 (a8b34197-cd92-411d-8a58-84cd7fca3242): created successfully Nov 03 17:19:38 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b513119-2a92-4154-b5d9-82acfd8b64ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Flow 'volume_create_manager' (df98f576-7f97-49bc-8278-65ec613727a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:38 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-cbbe4224-9fdf-4fe2-8741-01308a5f4c2b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created volume successfully. Nov 03 17:19:39 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374" returned: 0 in 0.398s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:39 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374 Nov 03 17:19:39 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:39 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca 1073741824" returned: 0 in 0.553s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:39 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1504225e-b9f1-478f-8e57-a2c0ecfbf374" returned: 0 in 0.263s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:39 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca Nov 03 17:19:39 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-quobyte-1504225e-b9f1-478f-8e57-a2c0ecfbf374" released by "delete_volume" :: held 0.731s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Created reservations ['66eaa24b-6bb8-447b-8a68-37a4316d395e', '8a1bb10a-f238-4bdd-b54a-ff9f3d61b4d9', '55e62502-b4f5-4f72-a073-0af21f93ae52', '73f4b514-eff0-491c-9fb4-62a375924c69'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-a8b34197-cd92-411d-8a58-84cd7fca3242-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-a8b34197-cd92-411d-8a58-84cd7fca3242-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-quobyte-a8b34197-cd92-411d-8a58-84cd7fca3242" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-a8b34197-cd92-411d-8a58-84cd7fca3242" acquired by "delete_volume" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:39 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[afda08f7-ba6c-43dd-8cbf-2b54d8400b60]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:39 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:39 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca" returned: 0 in 0.306s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.497s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1446830872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a770797d-8a44-405f-b184-c59d33e1340c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:35Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Creating volume a770797d-8a44-405f-b184-c59d33e1340c {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:39 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Attempting download of 42a84dd8-96a8-4388-8ca8-08ff398cf43c ((None, [{'url': 'file:///opt/stack/data/glance/images/42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'metadata': {}}])) to volume 08f01d2e-f65e-4887-94c9-ae014b13daca. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:19:39 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c 1073741824 Nov 03 17:19:39 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:39 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242 Nov 03 17:19:39 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "cinder-40625138-23ec-4c44-b558-e2842da35ce0-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-40625138-23ec-4c44-b558-e2842da35ce0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3e0020-2929-449e-aa6f-f1a325bfd7a2]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42a84dd8-96a8-4388-8ca8-08ff398cf43c_nwutfpyf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "cinder-quobyte-40625138-23ec-4c44-b558-e2842da35ce0" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-quobyte-40625138-23ec-4c44-b558-e2842da35ce0" acquired by "delete_volume" :: waited 0.033s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:39 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42a84dd8-96a8-4388-8ca8-08ff398cf43c_nwutfpyf Nov 03 17:19:39 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2e1ab6-1314-4887-a8a3-3478d3320e48]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:40 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.481s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:40 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Deleted volume successfully. Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a2347e07-6b0e-4ee6-ab94-bccc6b0b6817 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-1504225e-b9f1-478f-8e57-a2c0ecfbf374-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:40 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0 Nov 03 17:19:40 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:40 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242" returned: 0 in 0.565s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:40 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242 Nov 03 17:19:40 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:40 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42a84dd8-96a8-4388-8ca8-08ff398cf43c_nwutfpyf" returned: 0 in 0.424s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42a84dd8-96a8-4388-8ca8-08ff398cf43c_nwutfpyf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:40 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42a84dd8-96a8-4388-8ca8-08ff398cf43c_nwutfpyf Nov 03 17:19:40 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:40 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c 1073741824" returned: 0 in 0.748s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:40 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a8b34197-cd92-411d-8a58-84cd7fca3242" returned: 0 in 0.295s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:40 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c Nov 03 17:19:40 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-a8b34197-cd92-411d-8a58-84cd7fca3242" released by "delete_volume" :: held 0.940s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:40 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0" returned: 0 in 0.498s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:40 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0 Nov 03 17:19:40 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created reservations ['44c3bb76-7700-4ddf-9d9b-1f07a1534e0d', 'd9d7bab3-33d7-4dfe-9d82-f4f16cd6d5a1', '80fa1c2e-d6ea-430b-830d-b4cdee5f0d53', 'cdb2210b-2dd2-4355-98d6-8ce64e704f2e'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:40 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42a84dd8-96a8-4388-8ca8-08ff398cf43c_nwutfpyf" returned: 1 in 0.462s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42a84dd8-96a8-4388-8ca8-08ff398cf43c_nwutfpyf' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbb9b5b-e75b-473a-8315-d5e2c7d8051a]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:40 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:40 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:40 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c" returned: 0 in 0.297s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.207s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-416617385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95af8aba-1670-428c-9ec1-cd2c8a73fc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:35Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Creating volume 95af8aba-1670-428c-9ec1-cd2c8a73fc4d {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:40 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec1ce2e-086c-4da2-a14a-8034a18013be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a770797d-8a44-405f-b184-c59d33e1340c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:40 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d 1073741824 Nov 03 17:19:40 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3264fe33-d195-4e15-9e28-589da90de96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:40 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume volume-a770797d-8a44-405f-b184-c59d33e1340c (a770797d-8a44-405f-b184-c59d33e1340c): created successfully Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3264fe33-d195-4e15-9e28-589da90de96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (c66258be-cd9a-429c-bdb1-becb68638f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:40 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD Nov 03 17:19:40 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:40 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-620daa21-aada-4b8b-976a-ed7260bd0a17 tempest-CreateVolumesFromSnapshotTest-650814363 None] Created volume successfully. Nov 03 17:19:40 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-40625138-23ec-4c44-b558-e2842da35ce0" returned: 0 in 0.382s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-quobyte-40625138-23ec-4c44-b558-e2842da35ce0" released by "delete_volume" :: held 0.977s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:40 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.334s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:40 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Deleted volume successfully. Nov 03 17:19:40 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Created reservations ['c22a395c-5deb-40ff-abed-e19f8a7ac981', '35a8ecb1-a565-4636-a542-7701ab985f34', '2b1629c4-f520-48a7-b1ca-5373be982a5b', '8bd220af-036f-47e6-a71d-8dadab4702e1'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0a460059-65ec-4384-87f6-2c0e3c323007 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-a8b34197-cd92-411d-8a58-84cd7fca3242-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:41 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:41 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:41 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:41 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD Nov 03 17:19:41 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:41 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d 1073741824" returned: 0 in 0.636s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:41 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.289s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:41 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Deleted volume successfully. Nov 03 17:19:41 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d Nov 03 17:19:41 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:41 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD" returned: 1 in 0.370s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] 42a84dd8-96a8-4388-8ca8-08ff398cf43c was raw, converting to qcow2 {{(pid=86661) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-fa5e7155-bf28-48d0-8ef7-c263284ad008 tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-40625138-23ec-4c44-b558-e2842da35ce0-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:41 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca Nov 03 17:19:41 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-38a14993-ac09-414d-9dbf-c34a48c19955-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-38a14993-ac09-414d-9dbf-c34a48c19955-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:41 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d" returned: 0 in 0.307s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.669s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1562925561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a27d7b-4cf3-4923-a86a-de34fe5edf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:36Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Creating volume 44a27d7b-4cf3-4923-a86a-de34fe5edf8c {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:41 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:41 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c 1073741824 Nov 03 17:19:41 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-quobyte-38a14993-ac09-414d-9dbf-c34a48c19955" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ccbde8-dd43-49a1-971b-763a265fad43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0408fa2-0a29-493b-85c8-47558d3c18e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-38a14993-ac09-414d-9dbf-c34a48c19955" acquired by "delete_volume" :: waited 0.044s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:41 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d (95af8aba-1670-428c-9ec1-cd2c8a73fc4d): created successfully Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0408fa2-0a29-493b-85c8-47558d3c18e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (13fca563-839b-42ce-9d45-fa6082477bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[d798c54c-f7d5-463f-a029-7c267bc16b12]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:41 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ec9312f7-5ddc-4171-b0a5-a20085e6e07c tempest-CreateVolumesFromSnapshotTest-650814363 None] Created volume successfully. Nov 03 17:19:42 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955 Nov 03 17:19:42 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "cinder-ef39b0c2-ad2b-4841-b892-17d620d36f44-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:42 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca" returned: 0 in 0.620s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_42a84dd8-96a8-4388-8ca8-08ff398cf43c_u6ad1r02devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:19:42 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-ef39b0c2-ad2b-4841-b892-17d620d36f44-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:42 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca 1G Nov 03 17:19:42 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "cinder-quobyte-ef39b0c2-ad2b-4841-b892-17d620d36f44" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-quobyte-ef39b0c2-ad2b-4841-b892-17d620d36f44" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[96855af2-da66-48e1-8913-ece8a500fe79]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:42 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c 1073741824" returned: 0 in 0.634s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:42 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:42 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44 Nov 03 17:19:42 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955" returned: 0 in 0.575s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:42 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c Nov 03 17:19:42 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:42 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955 Nov 03 17:19:42 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:42 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca 1G" returned: 0 in 0.470s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Downloaded image 42a84dd8-96a8-4388-8ca8-08ff398cf43c ((None, [{'url': 'file:///opt/stack/data/glance/images/42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'metadata': {}}])) to volume 08f01d2e-f65e-4887-94c9-ae014b13daca successfully. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Temporary image 42a84dd8-96a8-4388-8ca8-08ff398cf43c for user 5495f67c4d1045eea3a5ebdf227db5ac is deleted. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Marking volume 08f01d2e-f65e-4887-94c9-ae014b13daca as bootable. {{(pid=86661) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Copying metadata from image 42a84dd8-96a8-4388-8ca8-08ff398cf43c to 08f01d2e-f65e-4887-94c9-ae014b13daca. {{(pid=86661) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Creating volume glance metadata for volume 08f01d2e-f65e-4887-94c9-ae014b13daca backed by image 42a84dd8-96a8-4388-8ca8-08ff398cf43c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '67256ca69121496f20465449a45eefe6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86661) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6730c5a-05d0-4a0b-8a85-0718d8047080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f01d2e-f65e-4887-94c9-ae014b13daca', 'volume_size': 1, 'image_id': '42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '67256ca69121496f20465449a45eefe6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '198bc1e28ab74d4788bdd02198b33de9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1ba77c4712f6c4d2d1052689d17895408f2993b704564e9105a89e78d38210f0867bc0633e2a2ccf78b59b480cb8dcd6e87720569e5c42745d53246fe251a021', 'id': '42a84dd8-96a8-4388-8ca8-08ff398cf43c', 'created_at': datetime.datetime(2026, 11, 3, 16, 19, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 19, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42a84dd8-96a8-4388-8ca8-08ff398cf43c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6f7816-e15b-4644-b7ef-4aedcb682ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:42 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Volume volume-08f01d2e-f65e-4887-94c9-ae014b13daca (08f01d2e-f65e-4887-94c9-ae014b13daca): created successfully Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6f7816-e15b-4644-b7ef-4aedcb682ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Flow 'volume_create_manager' (bd13dc90-3933-4fa7-b8ec-045426dec38f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:42 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-38a14993-ac09-414d-9dbf-c34a48c19955" returned: 0 in 0.295s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:42 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a712d46d-8cc2-471b-a60e-59e09cca4152 tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Created volume successfully. Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-38a14993-ac09-414d-9dbf-c34a48c19955" released by "delete_volume" :: held 0.935s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:42 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44" returned: 0 in 0.541s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:42 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c" returned: 0 in 0.398s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.266s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:42 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44 Nov 03 17:19:42 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2058383243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ce29ba-a430-4236-8446-29edcde31b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:36Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Creating volume 92ce29ba-a430-4236-8446-29edcde31b87 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:42 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created reservations ['dab1dee0-abef-4495-a418-2c3371a75b29', 'd7558ed2-50d8-43d5-894c-5ae0b6ea5dc3', 'a90a4b2c-9c76-46be-a1f0-f282846bc208', '3e2c8070-1648-4a46-a3e6-f4d308f6dc77'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a28af4-a45e-48e9-81e5-c1d51556c502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:42 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87 1073741824 Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c6a280-7a14-4e20-b85c-2e72f8fdbf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:42 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:42 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c (44a27d7b-4cf3-4923-a86a-de34fe5edf8c): created successfully Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c6a280-7a14-4e20-b85c-2e72f8fdbf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (dbb189fc-d0f2-4e66-bab6-a9bddfd86ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:42 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-0afccde2-3010-414f-b401-7d8d62126a45 tempest-CreateVolumesFromSnapshotTest-650814363 None] Created volume successfully. Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:42 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:42 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:43 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef39b0c2-ad2b-4841-b892-17d620d36f44" returned: 0 in 0.283s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-quobyte-ef39b0c2-ad2b-4841-b892-17d620d36f44" released by "delete_volume" :: held 0.890s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Created reservations ['faef04c3-0998-43c6-8b6a-9b3d06ab22fd', 'b860b0bb-533c-4996-8f77-08e88b9d66c6', '457eedab-68f3-436c-ada0-1310950b32dd', '78a57d0a-0311-4b73-a10e-9762c4d476e0'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:43 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.316s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:43 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Deleted volume successfully. Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-99fe93d0-0e2e-449b-ae09-d71ca7c8e2f7 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-38a14993-ac09-414d-9dbf-c34a48c19955-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:43 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:43 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:43 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87 1073741824" returned: 0 in 0.723s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Acquiring lock "cinder-08f01d2e-f65e-4887-94c9-ae014b13daca-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:43 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87 Nov 03 17:19:43 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Lock "cinder-08f01d2e-f65e-4887-94c9-ae014b13daca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:43 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.381s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:43 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Deleted volume successfully. Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-bf4b2a1d-f971-4723-9b3a-7483cef3e5ef tempest-CreateVolumesFromImageTest-2072174413 None] Lock "cinder-ef39b0c2-ad2b-4841-b892-17d620d36f44-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Acquiring lock "cinder-quobyte-08f01d2e-f65e-4887-94c9-ae014b13daca" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Lock "cinder-quobyte-08f01d2e-f65e-4887-94c9-ae014b13daca" acquired by "delete_volume" :: waited 0.042s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ef8c36-fa36-4992-902a-04803ad9986d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-bd3b4ace-8249-4785-9d61-71e17fe57def-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-bd3b4ace-8249-4785-9d61-71e17fe57def-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:43 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87" returned: 0 in 0.350s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.075s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1591564060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d0ed98-8169-416e-8cd2-e988cedd7f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081756e8765a4603b84af5b2b51de0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:37Z,use_quota=True,user_id='86fd0f59058642bbb49bf28814358c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Creating volume 26d0ed98-8169-416e-8cd2-e988cedd7f31 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:43 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:44 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca Nov 03 17:19:44 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e21c60-22b7-46c9-8b07-d36c94af802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ce29ba-a430-4236-8446-29edcde31b87', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:44 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31 1073741824 Nov 03 17:19:44 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf59ea22-3766-477b-a587-0fe9c44dc8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:44 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume volume-92ce29ba-a430-4236-8446-29edcde31b87 (92ce29ba-a430-4236-8446-29edcde31b87): created successfully Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf59ea22-3766-477b-a587-0fe9c44dc8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (2f67e971-fd1f-455f-915a-0fe6add16a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-quobyte-bd3b4ace-8249-4785-9d61-71e17fe57def" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:44 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-0b2d8a6f-23ff-411d-b470-32cc72807c30 tempest-CreateVolumesFromSnapshotTest-650814363 None] Created volume successfully. Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-bd3b4ace-8249-4785-9d61-71e17fe57def" acquired by "delete_volume" :: waited 0.028s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb42e51d-4f00-469f-ba4e-2dfefddea921]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:44 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def Nov 03 17:19:44 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:44 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca" returned: 0 in 0.514s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:44 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca Nov 03 17:19:44 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:44 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def" returned: 0 in 0.515s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:44 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31 1073741824" returned: 0 in 0.718s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:44 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def Nov 03 17:19:44 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:44 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31 Nov 03 17:19:44 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:44 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-08f01d2e-f65e-4887-94c9-ae014b13daca" returned: 0 in 0.472s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Lock "cinder-quobyte-08f01d2e-f65e-4887-94c9-ae014b13daca" released by "delete_volume" :: held 1.053s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:44 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Created reservations ['3497d7da-8c17-4030-9014-f54d2ebb5d10', '844fedc8-9b7d-4417-8f99-263417099385', 'a4977f82-e217-4b0e-9be1-62a0a333adc7', '618615b9-b7b0-4b47-ab93-3de12f25c1ef'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:45 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-bd3b4ace-8249-4785-9d61-71e17fe57def" returned: 0 in 0.449s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-bd3b4ace-8249-4785-9d61-71e17fe57def" released by "delete_volume" :: held 1.038s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:45 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31" returned: 0 in 0.422s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:45 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:45 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ee7e3a-bb3b-4ad1-b25c-91a4335e3100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d0ed98-8169-416e-8cd2-e988cedd7f31', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d10afb4-985f-48ff-a70b-855571ff4f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:45 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Volume volume-26d0ed98-8169-416e-8cd2-e988cedd7f31 (26d0ed98-8169-416e-8cd2-e988cedd7f31): created successfully Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d10afb4-985f-48ff-a70b-855571ff4f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Flow 'volume_create_manager' (d784c269-5801-48a8-8062-03b647440107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:45 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-17a8974e-0136-4011-adce-7816b22d4c01 tempest-CreateVolumesFromSnapshotTest-650814363 None] Created volume successfully. Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created reservations ['96f4b3cc-affe-41d0-a07a-370d9b866344', 'b0fe0625-51e7-4e4f-9cd4-62ae8438f902', 'ba4d390a-ad39-42ac-bfd0-00e443b9e970', 'd3644f02-1834-4ab7-a73b-6b8c0c33570b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:45 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:45 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:45 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.287s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:45 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Deleted volume successfully. Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-61f41b49-ce37-4122-b957-738fd030ccba tempest-VolumeAndVolumeTypeFromImageTest-1673795250 None] Lock "cinder-08f01d2e-f65e-4887-94c9-ae014b13daca-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:45 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.309s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:45 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Deleted volume successfully. Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2a7794b2-e0f3-443e-91be-1f0050bb4e44 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-bd3b4ace-8249-4785-9d61-71e17fe57def-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-26d0ed98-8169-416e-8cd2-e988cedd7f31-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-26d0ed98-8169-416e-8cd2-e988cedd7f31-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-quobyte-26d0ed98-8169-416e-8cd2-e988cedd7f31" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-26d0ed98-8169-416e-8cd2-e988cedd7f31" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b46985-ba41-4253-a0f4-6da0bf03bc80]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:46 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31 Nov 03 17:19:46 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-361bde25-76ea-49ab-9279-f098c3d93d74-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-361bde25-76ea-49ab-9279-f098c3d93d74-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-quobyte-361bde25-76ea-49ab-9279-f098c3d93d74" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-361bde25-76ea-49ab-9279-f098c3d93d74" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ed2fa2-5ba6-45ad-9735-e20b16ae64f8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:46 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31" returned: 0 in 0.522s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:46 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31 Nov 03 17:19:46 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:46 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74 Nov 03 17:19:46 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:46 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-26d0ed98-8169-416e-8cd2-e988cedd7f31" returned: 0 in 0.328s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-26d0ed98-8169-416e-8cd2-e988cedd7f31" released by "delete_volume" :: held 0.906s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:46 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74" returned: 0 in 0.435s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:46 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74 Nov 03 17:19:46 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:46 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Created reservations ['ad343cda-9a45-4ac1-b4a0-535ab1b421e9', '8cf6b52a-f775-4856-8cf1-e12658245f92', '6f9dfa70-8fbe-4cda-8985-f1d0c203fb7b', '60179848-1d02-4ac2-bd82-461276046481'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:47 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:47 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-92ce29ba-a430-4236-8446-29edcde31b87-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-92ce29ba-a430-4236-8446-29edcde31b87-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-quobyte-92ce29ba-a430-4236-8446-29edcde31b87" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-92ce29ba-a430-4236-8446-29edcde31b87" acquired by "delete_volume" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:47 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-361bde25-76ea-49ab-9279-f098c3d93d74" returned: 0 in 0.423s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-361bde25-76ea-49ab-9279-f098c3d93d74" released by "delete_volume" :: held 0.921s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92d977e-df0d-49f5-88cf-3994df73cc9e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created reservations ['aa431a08-7937-40e7-85d6-86a26fc3dd86', 'e77ab597-3aa4-4e69-be9e-3b1a427708c8', 'e61fa5a9-7977-4f0c-aa3c-a2ab49605e99', '6593b1d3-6e66-456c-8cf0-2fb2739462d8'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:47 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.343s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:47 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Deleted volume successfully. Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-17b8b650-6064-42bd-b87a-85f2b468329f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-26d0ed98-8169-416e-8cd2-e988cedd7f31-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:47 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87 Nov 03 17:19:47 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:47 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:47 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:47 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.364s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:47 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:47 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Deleted volume successfully. Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87" returned: 0 in 0.612s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-51e07e2c-1f46-457b-b458-7a535f08ba30 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-361bde25-76ea-49ab-9279-f098c3d93d74-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:47 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87 Nov 03 17:19:47 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:48 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-92ce29ba-a430-4236-8446-29edcde31b87" returned: 0 in 0.291s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-92ce29ba-a430-4236-8446-29edcde31b87" released by "delete_volume" :: held 0.974s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-2f7c5a60-94de-4df8-9fb3-e7445eae03b1 tempest-ProjectAdminTests-1548543339 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5803260803223, 'free_capacity_gb': 1773.5803260803223, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86661) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Created reservations ['abd0ecc1-18eb-4761-b247-96314440f244', '3ab175da-55c4-47c9-809a-ace794200bf7', '0e2ff03f-6d73-4a41-9e1e-2ba9f11facc9', '281bf07f-c182-4178-8836-09b0b36cf13a'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:48 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:48 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-39a277f6-7358-4936-9960-2a14399a7279-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-39a277f6-7358-4936-9960-2a14399a7279-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-quobyte-39a277f6-7358-4936-9960-2a14399a7279" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-39a277f6-7358-4936-9960-2a14399a7279" acquired by "delete_volume" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:48 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.401s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Deleted volume successfully. Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ea737c-3e79-4fe4-9f6a-28d8eb3118c4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:48 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-0222e3f8-f1b8-456d-bab3-da5917340f76 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-92ce29ba-a430-4236-8446-29edcde31b87-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:48 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279 Nov 03 17:19:48 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:49 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279" returned: 0 in 0.423s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:49 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279 Nov 03 17:19:49 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-44a27d7b-4cf3-4923-a86a-de34fe5edf8c-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-44a27d7b-4cf3-4923-a86a-de34fe5edf8c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-quobyte-44a27d7b-4cf3-4923-a86a-de34fe5edf8c" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:49 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-39a277f6-7358-4936-9960-2a14399a7279" returned: 0 in 0.360s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-44a27d7b-4cf3-4923-a86a-de34fe5edf8c" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-39a277f6-7358-4936-9960-2a14399a7279" released by "delete_volume" :: held 0.889s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b641e199-7319-4a22-a374-31086d0a458b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created reservations ['85d662cc-11d5-4f12-88de-9d11977e7192', 'f1d032fb-c72e-4dfc-ac82-8c85af539950', '47998322-a0c5-4319-94e7-fa4c65cd2492', '57bfcf18-4885-4297-9a99-871a1ab54f42'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:49 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c Nov 03 17:19:49 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:50 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:50 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:50 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c" returned: 0 in 0.499s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:50 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c Nov 03 17:19:50 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:50 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.323s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:50 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Deleted volume successfully. Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ab758c3-d43c-4c9b-8749-14eec152d06b tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-39a277f6-7358-4936-9960-2a14399a7279-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:50 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-44a27d7b-4cf3-4923-a86a-de34fe5edf8c" returned: 0 in 0.326s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-44a27d7b-4cf3-4923-a86a-de34fe5edf8c" released by "delete_volume" :: held 0.892s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Created reservations ['2cfb3917-6a46-48bc-b49b-9ff6c4f55f9d', '4be461b9-796c-43e4-a5f1-2b9298e562dc', '20847102-d074-45cd-b5f0-36385401fa96', '8c8953da-ec15-4b88-84ff-ba3fb3679bba'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:50 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:50 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-95af8aba-1670-428c-9ec1-cd2c8a73fc4d-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-95af8aba-1670-428c-9ec1-cd2c8a73fc4d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-quobyte-95af8aba-1670-428c-9ec1-cd2c8a73fc4d" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-95af8aba-1670-428c-9ec1-cd2c8a73fc4d" acquired by "delete_volume" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8717573b-b08d-4222-9b65-134ddb53ca28]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-e4589c5f-4d9b-4e62-8524-d50c774cde61-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-e4589c5f-4d9b-4e62-8524-d50c774cde61-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "cinder-quobyte-e4589c5f-4d9b-4e62-8524-d50c774cde61" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-e4589c5f-4d9b-4e62-8524-d50c774cde61" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:51 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.461s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:51 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d Nov 03 17:19:51 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:51 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Deleted volume successfully. Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b5c88a-3735-49bc-bee4-74decfcc4dbf]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-369e5aac-44c7-448a-9679-d96538909d66 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-44a27d7b-4cf3-4923-a86a-de34fe5edf8c-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:51 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61 Nov 03 17:19:51 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:51 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d" returned: 0 in 0.482s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:51 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d Nov 03 17:19:51 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:51 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61" returned: 0 in 0.468s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:51 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61 Nov 03 17:19:51 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:51 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-95af8aba-1670-428c-9ec1-cd2c8a73fc4d" returned: 0 in 0.321s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-95af8aba-1670-428c-9ec1-cd2c8a73fc4d" released by "delete_volume" :: held 0.871s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Created reservations ['93b6d76b-f3d0-4865-92db-1bf934d1c99b', '28859af3-9119-45e4-b123-d10d79d36074', 'bff802fb-05d0-4b5a-bd4a-17ba85a4e80a', '2b3501e3-0d49-4101-b4a4-77530a2809ec'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:52 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-e4589c5f-4d9b-4e62-8524-d50c774cde61" returned: 0 in 0.353s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-quobyte-e4589c5f-4d9b-4e62-8524-d50c774cde61" released by "delete_volume" :: held 0.909s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:52 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:52 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-a770797d-8a44-405f-b184-c59d33e1340c-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-a770797d-8a44-405f-b184-c59d33e1340c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Created reservations ['d015cdc1-1026-4ef7-ae60-0ab67a991f51', 'faa7ea3d-b881-461b-9dd4-503af2530bb8', '66ec9da1-6607-4c78-87cc-ca5bb0a96750', '761ff55e-06e0-4f53-b182-e449c66510fc'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-quobyte-a770797d-8a44-405f-b184-c59d33e1340c" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-a770797d-8a44-405f-b184-c59d33e1340c" acquired by "delete_volume" :: waited 0.042s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded691d2-6c01-4b24-8b26-d106497c6930]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:52 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.391s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:52 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Deleted volume successfully. Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cceab006-ff45-4802-b8e5-31a21f49f5a2 tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-95af8aba-1670-428c-9ec1-cd2c8a73fc4d-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:52 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c Nov 03 17:19:52 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:52 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:52 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:52 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.345s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:52 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Deleted volume successfully. Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-604d7b6c-8d65-4a1f-aa79-32bb30dbaa88 tempest-CreateVolumesFromSourceVolumeTest-416254142 None] Lock "cinder-e4589c5f-4d9b-4e62-8524-d50c774cde61-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:52 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c" returned: 0 in 0.492s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:52 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c Nov 03 17:19:52 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:53 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a770797d-8a44-405f-b184-c59d33e1340c" returned: 0 in 0.280s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-a770797d-8a44-405f-b184-c59d33e1340c" released by "delete_volume" :: held 0.839s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Created reservations ['12821beb-ffa9-4308-a00d-25177c6a06b1', '566eea68-09cf-4acd-8f77-813abb941e0a', '9927f17e-b131-4c8f-b0f3-f8668c7365c3', '0d973125-a39d-42bb-978c-11d5a166d7f5'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:53 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:53 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-quobyte-94f6278a-b73f-4568-930b-1719f850a52b" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-94f6278a-b73f-4568-930b-1719f850a52b" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-quobyte-c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Deleting offline snapshot c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 of volume 94f6278a-b73f-4568-930b-1719f850a52b {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] snapshot_file for this snap is: volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[906e88d6-89ff-4930-95b7-f5bcd1a6f13a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:53 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.354s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:53 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Deleted volume successfully. Nov 03 17:19:53 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 Nov 03 17:19:53 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:53 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4ce8bc01-3dc6-400c-bf72-9c425bd4d3fc tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-a770797d-8a44-405f-b184-c59d33e1340c-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:54 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5" returned: 0 in 0.511s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:54 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94f6278a-b73f-4568-930b-1719f850a52b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:19:54 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed285ae-6c47-4d9a-a228-c4302cbfbc95]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:54 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b Nov 03 17:19:54 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:54 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b" returned: 0 in 0.517s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:54 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 Nov 03 17:19:54 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:55 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5" returned: 0 in 0.491s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:55 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5 Nov 03 17:19:55 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:55 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b.c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5" returned: 0 in 0.322s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5" released by "_delete_snapshot" :: held 2.034s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-94f6278a-b73f-4568-930b-1719f850a52b" released by "delete_snapshot" :: held 2.074s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Created reservations ['d30d14fa-5a22-4144-bb51-6c4827fd73e0', 'f263e133-3eb2-4c8a-bb22-9d573e8450d7', 'a6d4703c-3c57-4224-96d0-93d9ed4cba88', '9bc71189-40c6-4b03-9637-994de5051636'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:55 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Delete snapshot completed successfully. Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-150f6285-041e-4bc9-9245-2121b1f5510f tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-c2a669e6-5e3e-4e33-bed2-f2b1a51f85a5-delete_snapshot" released by "delete_snapshot" :: held 2.366s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Flow 'volume_create_manager' (059d8e85-df28-4495-9946-8f2e98e4b89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33106e1d-d6ef-4055-bdaa-cb800aa37b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33106e1d-d6ef-4055-bdaa-cb800aa37b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4789c-e7c3-40e9-a866-58e67a6c5de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c445a13c971455780ac64c3e300979a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:56Z,use_quota=True,user_id='f67e2e32653e4ee29a6888a6074681bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:55 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1332f32b-d7fa-44ea-bef0-7c10f8ea352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1332f32b-d7fa-44ea-bef0-7c10f8ea352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5b796c-f92e-449f-87d2-6f91497db657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.image.glance [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Creating Keystone auth plugin from conf {{(pid=86661) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5b796c-f92e-449f-87d2-6f91497db657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6af4789c-e7c3-40e9-a866-58e67a6c5de1', 'volume_name': 'volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1', 'volume_size': 1, 'image_id': '8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bd1b262367599a0118ceabce02d2603f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c445a13c971455780ac64c3e300979a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43341d8c2da85849ff580e6aad96761ee8cf6935f94242115d6a6070757aacbc66620cb1d2e398f8db1822daae01342ae43076e37a88bc5731ededc4589b8bf0', 'id': '8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'created_at': datetime.datetime(2026, 11, 3, 16, 19, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 19, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dd63368-5314-4fdf-bfcc-82d8b1894c22/file', 'properties': {}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10493e2-5002-4fdb-95e5-4ab56b142dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10493e2-5002-4fdb-95e5-4ab56b142dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf18327-6422-4a8c-9f62-d7489114fab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:56 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Volume 6af4789c-e7c3-40e9-a866-58e67a6c5de1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1', 'volume_size': 1, 'image_id': '8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bd1b262367599a0118ceabce02d2603f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c445a13c971455780ac64c3e300979a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43341d8c2da85849ff580e6aad96761ee8cf6935f94242115d6a6070757aacbc66620cb1d2e398f8db1822daae01342ae43076e37a88bc5731ededc4589b8bf0', 'id': '8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'created_at': datetime.datetime(2026, 11, 3, 16, 19, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 19, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dd63368-5314-4fdf-bfcc-82d8b1894c22/file', 'properties': {}}, 'image_service': } Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Trying to clone 6af4789c-e7c3-40e9-a866-58e67a6c5de1 from image 8dd63368-5314-4fdf-bfcc-82d8b1894c22 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'metadata': {}}]). {{(pid=86661) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-94f6278a-b73f-4568-930b-1719f850a52b-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-94f6278a-b73f-4568-930b-1719f850a52b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 17:19:56 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Image download 0.00 MB at 0.00 MB/s Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "cinder-quobyte-94f6278a-b73f-4568-930b-1719f850a52b" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deba3c1-d242-4c3d-a055-d0515cf955ab]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-94f6278a-b73f-4568-930b-1719f850a52b" acquired by "delete_volume" :: waited 0.049s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42465a0-e4e5-43da-8b48-cffc4aeef93c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:56 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD Nov 03 17:19:56 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:57 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b Nov 03 17:19:57 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:57 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:57 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD Nov 03 17:19:57 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:57 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b" returned: 0 in 0.542s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:57 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b Nov 03 17:19:57 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:57 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD" returned: 1 in 0.522s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Temporary image 8dd63368-5314-4fdf-bfcc-82d8b1894c22 is fetched for user f67e2e32653e4ee29a6888a6074681bf. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 17:19:57 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-94f6278a-b73f-4568-930b-1719f850a52b" returned: 0 in 0.397s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Flow 'volume_create_manager' (f70f2341-70da-4635-9bf1-d9b8eeee8fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c80dfe-e9ad-4826-a6a5-7a88eedefe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-quobyte-94f6278a-b73f-4568-930b-1719f850a52b" released by "delete_volume" :: held 1.104s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c80dfe-e9ad-4826-a6a5-7a88eedefe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-496980110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99eba4d9-33e7-4535-be21-43edf802761e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42b2404744d47298bf97fcc31f0e725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:58Z,use_quota=True,user_id='772e0542a8b24197bc75e7361466e060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb209f59-407a-4f82-a0da-3ae32f75f2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb209f59-407a-4f82-a0da-3ae32f75f2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35507360-5eba-4415-b9d3-9f36d605e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35507360-5eba-4415-b9d3-9f36d605e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99eba4d9-33e7-4535-be21-43edf802761e', 'volume_name': 'volume-99eba4d9-33e7-4535-be21-43edf802761e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81c5ead-e444-41bf-b424-2aaa681c4a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81c5ead-e444-41bf-b424-2aaa681c4a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab80937-0de6-464a-997a-f2e5f5de3559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:57 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Volume 99eba4d9-33e7-4535-be21-43edf802761e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99eba4d9-33e7-4535-be21-43edf802761e', 'volume_size': 1} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-496980110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99eba4d9-33e7-4535-be21-43edf802761e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42b2404744d47298bf97fcc31f0e725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:58Z,use_quota=True,user_id='772e0542a8b24197bc75e7361466e060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Creating volume 99eba4d9-33e7-4535-be21-43edf802761e {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:57 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fde0e7-c082-4123-9550-09a6b727abcc]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:19:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:57 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e 1073741824 Nov 03 17:19:57 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Created reservations ['423551cc-0baf-4f0e-9639-ae2e0ca4e1e8', '5848d338-cc2e-4eb2-a4ef-0000f54f33c4', '72f6b26c-dbc5-43ed-8342-6aa19fbe585c', '77c2c9ef-d834-47bc-8f5a-aa3003f00ee7'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:19:58 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD Nov 03 17:19:58 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:58 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:19:58 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:58 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:58 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e 1073741824" returned: 0 in 0.549s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:58 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.370s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:19:58 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Deleted volume successfully. Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:58 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD Nov 03 17:19:58 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b48a2c77-5f17-4a5a-a618-d20e3dcabb8d tempest-CreateVolumesFromSnapshotTest-650814363 None] Lock "cinder-94f6278a-b73f-4568-930b-1719f850a52b-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:19:58 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e Nov 03 17:19:58 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:58 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:58 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e" returned: 0 in 0.299s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4789c-e7c3-40e9-a866-58e67a6c5de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c445a13c971455780ac64c3e300979a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:19:56Z,use_quota=True,user_id='f67e2e32653e4ee29a6888a6074681bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Creating volume 6af4789c-e7c3-40e9-a866-58e67a6c5de1 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:19:58 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab80937-0de6-464a-997a-f2e5f5de3559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99eba4d9-33e7-4535-be21-43edf802761e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:58 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 1073741824 Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cfea3b-4f12-433e-90ab-ea0ee801dd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:19:58 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:58 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Volume volume-99eba4d9-33e7-4535-be21-43edf802761e (99eba4d9-33e7-4535-be21-43edf802761e): created successfully Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73cfea3b-4f12-433e-90ab-ea0ee801dd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:19:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Flow 'volume_create_manager' (f70f2341-70da-4635-9bf1-d9b8eeee8fc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:19:58 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5502f5a8-61d3-4215-92f5-51c485dedb1d tempest-VolumeDependencyTests-520092410 None] Created volume successfully. Nov 03 17:19:59 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 1073741824" returned: 0 in 0.570s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:19:59 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 Nov 03 17:19:59 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:19:59 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Nov 03 17:19:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1" returned: 0 in 0.326s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:19:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:19:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:19:59 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Attempting download of 8dd63368-5314-4fdf-bfcc-82d8b1894c22 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'metadata': {}}])) to volume 6af4789c-e7c3-40e9-a866-58e67a6c5de1. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00ba985-ee22-48b9-986c-45701614387f]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dd63368-5314-4fdf-bfcc-82d8b1894c22_p3l_smk4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:00 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dd63368-5314-4fdf-bfcc-82d8b1894c22_p3l_smk4 Nov 03 17:20:00 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] Creating offline snapshot 241ad754-7929-4a3c-8f29-6d36b474eadd of volume 99eba4d9-33e7-4535-be21-43edf802761e {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[96223f7e-51f8-4b2f-b7c8-60c3d91d4c79]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:00 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dd63368-5314-4fdf-bfcc-82d8b1894c22_p3l_smk4" returned: 0 in 0.479s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:00 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dd63368-5314-4fdf-bfcc-82d8b1894c22_p3l_smk4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:00 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:00 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dd63368-5314-4fdf-bfcc-82d8b1894c22_p3l_smk4 Nov 03 17:20:00 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (4c7fcb2a-3655-4d59-83b4-0db796e9ef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c956101-706e-4907-befb-b488bf39c9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c956101-706e-4907-befb-b488bf39c9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1537648369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2e8319-2a89-4fa3-bacc-cab752b1a643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:01Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce480d-32ec-4578-8242-fd891ae35c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce480d-32ec-4578-8242-fd891ae35c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20df7fe3-ef55-4e33-8a64-ab8cafd87f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20df7fe3-ef55-4e33-8a64-ab8cafd87f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2e8319-2a89-4fa3-bacc-cab752b1a643', 'volume_name': 'volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05354ec7-666f-496e-ac36-74bf2d0408fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05354ec7-666f-496e-ac36-74bf2d0408fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fd1919-9a3b-4c63-9f87-ffcaa5abb485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:00 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Volume ef2e8319-2a89-4fa3-bacc-cab752b1a643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643', 'volume_size': 1} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:00 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e" returned: 0 in 0.498s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:00 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd 1G Nov 03 17:20:00 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:00 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dd63368-5314-4fdf-bfcc-82d8b1894c22_p3l_smk4" returned: 1 in 0.457s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dd63368-5314-4fdf-bfcc-82d8b1894c22_p3l_smk4' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4541dc-ba7c-4164-9892-7cd13e9b0a87]: (4, 'raw') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:01 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD Nov 03 17:20:01 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:01 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:01 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd 1G" returned: 0 in 0.525s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99eba4d9-33e7-4535-be21-43edf802761e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:01 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99eba4d9-33e7-4535-be21-43edf802761e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd Nov 03 17:20:01 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:01 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD Nov 03 17:20:01 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:01 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 17:20:01 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] 8dd63368-5314-4fdf-bfcc-82d8b1894c22 was raw, converting to qcow2 {{(pid=86661) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 17:20:01 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99eba4d9-33e7-4535-be21-43edf802761e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd" returned: 0 in 0.367s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:01 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd is being set with open permissions: ugo+rw Nov 03 17:20:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:01 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 Nov 03 17:20:01 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:01 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd Nov 03 17:20:01 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:02 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd" returned: 0 in 0.283s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:02 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.info Nov 03 17:20:02 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:02 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1" returned: 0 in 0.520s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dd63368-5314-4fdf-bfcc-82d8b1894c22_lduuf7aqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:20:02 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:02 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 1G Nov 03 17:20:02 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:02 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.info" returned: 0 in 0.280s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:02 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.info is being set with open permissions: ugo+rw Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:02 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.info Nov 03 17:20:02 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:02 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:02 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.info" returned: 0 in 0.349s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.957s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1537648369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2e8319-2a89-4fa3-bacc-cab752b1a643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:01Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Creating volume ef2e8319-2a89-4fa3-bacc-cab752b1a643 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:02 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 1G" returned: 0 in 0.527s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Downloaded image 8dd63368-5314-4fdf-bfcc-82d8b1894c22 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'metadata': {}}])) to volume 6af4789c-e7c3-40e9-a866-58e67a6c5de1 successfully. {{(pid=86661) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Temporary image 8dd63368-5314-4fdf-bfcc-82d8b1894c22 for user f67e2e32653e4ee29a6888a6074681bf is deleted. {{(pid=86661) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.volume_utils [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Marking volume 6af4789c-e7c3-40e9-a866-58e67a6c5de1 as bootable. {{(pid=86661) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 17:20:02 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 1073741824 Nov 03 17:20:02 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Copying metadata from image 8dd63368-5314-4fdf-bfcc-82d8b1894c22 to 6af4789c-e7c3-40e9-a866-58e67a6c5de1. {{(pid=86661) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Creating volume glance metadata for volume 6af4789c-e7c3-40e9-a866-58e67a6c5de1 backed by image 8dd63368-5314-4fdf-bfcc-82d8b1894c22 with: {'image_id': '8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'bd1b262367599a0118ceabce02d2603f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86661) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 17:20:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-768f713a-7782-4420-8958-9200598de402 tempest-VolumeDependencyTests-520092410 None] Create snapshot completed successfully Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf18327-6422-4a8c-9f62-d7489114fab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1', 'volume_size': 1, 'image_id': '8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bd1b262367599a0118ceabce02d2603f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6c445a13c971455780ac64c3e300979a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43341d8c2da85849ff580e6aad96761ee8cf6935f94242115d6a6070757aacbc66620cb1d2e398f8db1822daae01342ae43076e37a88bc5731ededc4589b8bf0', 'id': '8dd63368-5314-4fdf-bfcc-82d8b1894c22', 'created_at': datetime.datetime(2026, 11, 3, 16, 19, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 16, 19, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dd63368-5314-4fdf-bfcc-82d8b1894c22/file', 'properties': {}}, 'image_service': }' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151da259-188b-4fb9-a6e0-0a13dff6ed14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:02 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Volume volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 (6af4789c-e7c3-40e9-a866-58e67a6c5de1): created successfully Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151da259-188b-4fb9-a6e0-0a13dff6ed14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Flow 'volume_create_manager' (059d8e85-df28-4495-9946-8f2e98e4b89c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3be2562f-eb14-44b9-b308-2446b0cf2c42 tempest-VolumeImageDependencyTests-2114962976 None] Created volume successfully. Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Flow 'volume_create_manager' (280e6424-26d8-4bc9-9d27-cb36aa9f0593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2cb244-5a9a-4246-a187-903eb41e0fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2cb244-5a9a-4246-a187-903eb41e0fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b797605-8dc0-48c9-a2f6-926050f77dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d13dc4135bc4f82916a4de9e797ffb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:03Z,use_quota=True,user_id='dcb713985213446db96dbb425e7b92ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0dbd25-18c2-43e9-909e-0838eadde16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0dbd25-18c2-43e9-909e-0838eadde16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d0c33f-a297-4529-9d64-09e8a0000688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d0c33f-a297-4529-9d64-09e8a0000688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b797605-8dc0-48c9-a2f6-926050f77dee', 'volume_name': 'volume-1b797605-8dc0-48c9-a2f6-926050f77dee', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7695c53f-7b65-4a37-8f1f-7bbd765c4229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7695c53f-7b65-4a37-8f1f-7bbd765c4229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055b0018-c54c-4e44-8920-c6682719bee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:03 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Volume 1b797605-8dc0-48c9-a2f6-926050f77dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b797605-8dc0-48c9-a2f6-926050f77dee', 'volume_size': 1} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:03 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 1073741824" returned: 0 in 0.493s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:03 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 Nov 03 17:20:03 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:03 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643" returned: 0 in 0.254s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b797605-8dc0-48c9-a2f6-926050f77dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d13dc4135bc4f82916a4de9e797ffb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:03Z,use_quota=True,user_id='dcb713985213446db96dbb425e7b92ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Creating volume 1b797605-8dc0-48c9-a2f6-926050f77dee {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:03 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fd1919-9a3b-4c63-9f87-ffcaa5abb485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:03 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee 1073741824 Nov 03 17:20:03 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c89810-3030-4c7b-acf1-f89d3300a6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Acquiring lock "cinder-6af4789c-e7c3-40e9-a866-58e67a6c5de1-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:03 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Volume volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 (ef2e8319-2a89-4fa3-bacc-cab752b1a643): created successfully Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c89810-3030-4c7b-acf1-f89d3300a6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (4c7fcb2a-3655-4d59-83b4-0db796e9ef41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:03 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f52dc919-74a0-4cb4-aa68-ce0882b3e529 tempest-ProjectMemberTests-570738927 None] Created volume successfully. Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Lock "cinder-6af4789c-e7c3-40e9-a866-58e67a6c5de1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Acquiring lock "cinder-quobyte-6af4789c-e7c3-40e9-a866-58e67a6c5de1" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Lock "cinder-quobyte-6af4789c-e7c3-40e9-a866-58e67a6c5de1" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e42a644-3e9d-41fe-bf4c-a3fff8c69781]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:03 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 Nov 03 17:20:03 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:04 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee 1073741824" returned: 0 in 0.736s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:04 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee Nov 03 17:20:04 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:04 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1" returned: 0 in 0.543s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:04 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1 Nov 03 17:20:04 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Flow 'volume_create_manager' (d711d3aa-100a-443a-bbc7-e99304c05b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fde36a9-96d7-4288-a5ef-1e750491aa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:04 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fde36a9-96d7-4288-a5ef-1e750491aa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-995224582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcb3501-089e-45b4-8c2b-28d0f8b0107a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42b2404744d47298bf97fcc31f0e725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=241ad754-7929-4a3c-8f29-6d36b474eadd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:04Z,use_quota=True,user_id='772e0542a8b24197bc75e7361466e060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c6bb70-bc30-4301-a5e0-9559f65f86b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c6bb70-bc30-4301-a5e0-9559f65f86b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc79145-c2b3-496c-9f4d-320f1788bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc79145-c2b3-496c-9f4d-320f1788bafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cdcb3501-089e-45b4-8c2b-28d0f8b0107a', 'volume_name': 'volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a', 'volume_size': 1, 'snapshot_id': '241ad754-7929-4a3c-8f29-6d36b474eadd'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cae5db-faa5-4f0f-8455-e687a4275942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cae5db-faa5-4f0f-8455-e687a4275942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d22f746-3781-49e6-9f7f-670eb59991e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:04 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Volume cdcb3501-089e-45b4-8c2b-28d0f8b0107a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a', 'volume_size': 1, 'snapshot_id': '241ad754-7929-4a3c-8f29-6d36b474eadd'} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee" returned: 0 in 0.317s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.184s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:04 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055b0018-c54c-4e44-8920-c6682719bee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b797605-8dc0-48c9-a2f6-926050f77dee', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c47ab8c-d047-4709-b73a-3c2a8723cdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-6af4789c-e7c3-40e9-a866-58e67a6c5de1" returned: 0 in 0.317s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] Creating offline snapshot 3d33c493-b93e-491e-83cb-36fc26a05600 of volume ef2e8319-2a89-4fa3-bacc-cab752b1a643 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Lock "cinder-quobyte-6af4789c-e7c3-40e9-a866-58e67a6c5de1" released by "delete_volume" :: held 0.944s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:04 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Volume volume-1b797605-8dc0-48c9-a2f6-926050f77dee (1b797605-8dc0-48c9-a2f6-926050f77dee): created successfully Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c47ab8c-d047-4709-b73a-3c2a8723cdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Flow 'volume_create_manager' (280e6424-26d8-4bc9-9d27-cb36aa9f0593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6b7194-6087-40ed-bd2e-2d5c72af896e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-62079928-4744-452d-b54a-b0442fcafe32 tempest-CinderUnicodeTest-110206952 None] Created volume successfully. Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Created reservations ['003c919e-fcb3-4a89-a3ea-3e18ee224d44', '8e6a96d7-d798-46ca-a026-c8055d107a6c', '542a4709-d94a-48f1-bee4-2dc9c57042c3', 'b6391562-fb0d-4da4-93e0-59f3927f8524'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:04 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 Nov 03 17:20:04 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:04 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:04 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:05 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643" returned: 0 in 0.425s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:05 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 1G Nov 03 17:20:05 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:05 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.249s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:05 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:05 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Deleted volume successfully. Nov 03 17:20:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-62e7a64f-9f28-4e58-9fa8-53640939413c tempest-VolumeImageDependencyTests-2114962976 None] Lock "cinder-6af4789c-e7c3-40e9-a866-58e67a6c5de1-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:05 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 1G" returned: 0 in 0.417s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:05 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 Nov 03 17:20:05 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:05 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600" returned: 0 in 0.314s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:05 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 is being set with open permissions: ugo+rw Nov 03 17:20:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:05 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 Nov 03 17:20:05 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Flow 'volume_create_manager' (ceae67db-5642-4616-b94f-cc4332fe38cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c605abb-b071-454e-bebb-d797625b4604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c605abb-b071-454e-bebb-d797625b4604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1943672637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74a8769-1338-4a80-90da-2efe79f2d243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d13dc4135bc4f82916a4de9e797ffb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:06Z,use_quota=True,user_id='dcb713985213446db96dbb425e7b92ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a165232b-b961-4b25-a028-9a9e7fcfd47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a165232b-b961-4b25-a028-9a9e7fcfd47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78348780-4893-4eb7-be0a-6b3e586a711e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78348780-4893-4eb7-be0a-6b3e586a711e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a74a8769-1338-4a80-90da-2efe79f2d243', 'volume_name': 'volume-a74a8769-1338-4a80-90da-2efe79f2d243', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa58dea0-5ad7-40a7-b8ea-793c53c03152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa58dea0-5ad7-40a7-b8ea-793c53c03152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6388070d-30c3-49c4-929c-b1d39e0b0a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:06 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Volume a74a8769-1338-4a80-90da-2efe79f2d243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a74a8769-1338-4a80-90da-2efe79f2d243', 'volume_size': 1} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:06 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600" returned: 0 in 0.276s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:06 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.info Nov 03 17:20:06 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:06 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.info" returned: 0 in 0.265s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:06 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.info is being set with open permissions: ugo+rw Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:06 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.info Nov 03 17:20:06 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:06 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.info" returned: 0 in 0.243s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.065s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "cinder-quobyte-241ad754-7929-4a3c-8f29-6d36b474eadd-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" by "_create_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-241ad754-7929-4a3c-8f29-6d36b474eadd-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Creating volume cdcb3501-089e-45b4-8c2b-28d0f8b0107a from snapshot 241ad754-7929-4a3c-8f29-6d36b474eadd {{(pid=86661) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "cinder-quobyte-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:06 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5892e06a-54fd-4e1e-abda-97ed9f899719 tempest-ProjectMemberTests-570738927 None] Create snapshot completed successfully Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] snapshot: 241ad754-7929-4a3c-8f29-6d36b474eadd, volume: cdcb3501-089e-45b4-8c2b-28d0f8b0107a, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62bff69-9bd9-4579-a63a-8e5cdd4a6a38]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:06 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd Nov 03 17:20:06 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:07 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd" returned: 0 in 0.409s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99eba4d9-33e7-4535-be21-43edf802761e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac76b20-56f0-49de-b3c6-6672971a8d53]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:07 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e Nov 03 17:20:07 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-3d33c493-b93e-491e-83cb-36fc26a05600-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Lock "cinder-3d33c493-b93e-491e-83cb-36fc26a05600-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-ef2e8319-2a89-4fa3-bacc-cab752b1a643" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-ef2e8319-2a89-4fa3-bacc-cab752b1a643" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-3d33c493-b93e-491e-83cb-36fc26a05600" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-3d33c493-b93e-491e-83cb-36fc26a05600" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Deleting offline snapshot 3d33c493-b93e-491e-83cb-36fc26a05600 of volume ef2e8319-2a89-4fa3-bacc-cab752b1a643 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] snapshot_file for this snap is: volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c71afff-1ed2-46b2-8c65-d9f9b860be5a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:07 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e" returned: 0 in 0.461s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:20:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:07 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a Nov 03 17:20:07 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:07 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 Nov 03 17:20:07 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:08 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600" returned: 0 in 0.411s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:20:08 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8878d19-606b-4705-b32c-21506ca5c81a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:08 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 Nov 03 17:20:08 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:08 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643" returned: 0 in 0.518s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:08 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 Nov 03 17:20:08 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:09 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600" returned: 0 in 0.760s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:09 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600 Nov 03 17:20:09 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:09 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643.3d33c493-b93e-491e-83cb-36fc26a05600" returned: 0 in 0.417s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-3d33c493-b93e-491e-83cb-36fc26a05600" released by "_delete_snapshot" :: held 2.278s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-ef2e8319-2a89-4fa3-bacc-cab752b1a643" released by "delete_snapshot" :: held 2.324s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:10 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Created reservations ['27f00e71-697e-4a7c-8632-3bd57edf5eb8', '137e6671-83e5-435c-a577-3b4a8b5a216e', '60798e74-664f-4b62-9d30-e58ab36eef53', '9020c19f-a9fa-4efe-b00d-185c98842a6b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:10 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Delete snapshot completed successfully. Nov 03 17:20:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-aaa17210-2415-4bb6-a447-a40d3c0a1cb6 tempest-ProjectMemberTests-570738927 None] Lock "cinder-3d33c493-b93e-491e-83cb-36fc26a05600-delete_snapshot" released by "delete_snapshot" :: held 2.608s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-ef2e8319-2a89-4fa3-bacc-cab752b1a643-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Lock "cinder-ef2e8319-2a89-4fa3-bacc-cab752b1a643-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-ef2e8319-2a89-4fa3-bacc-cab752b1a643" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-ef2e8319-2a89-4fa3-bacc-cab752b1a643" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:11 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff348b5f-6f96-4782-9299-a3fd96943520]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:11 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 Nov 03 17:20:11 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:11 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643" returned: 0 in 0.614s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:11 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643 Nov 03 17:20:11 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:12 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-ef2e8319-2a89-4fa3-bacc-cab752b1a643" returned: 0 in 0.415s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-ef2e8319-2a89-4fa3-bacc-cab752b1a643" released by "delete_volume" :: held 1.175s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Created reservations ['f3eb2057-ec46-42d8-8070-1da95926ca13', '4129a4ed-5d53-441f-bee8-2b8c8509beca', '767183c2-ed88-4f2a-b8c2-82a290522f37', '7fb927bb-dcec-4787-862c-84d451f27e00'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:12 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:12 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:12 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.387s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:12 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Deleted volume successfully. Nov 03 17:20:12 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d93fc564-5b6b-477f-8c10-986d510be92d tempest-ProjectMemberTests-570738927 None] Lock "cinder-ef2e8319-2a89-4fa3-bacc-cab752b1a643-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (ccc6f156-8b6d-434b-ac4d-7230a7eb8993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b609e5-b6fe-4dd0-b209-9ba9a113f198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b609e5-b6fe-4dd0-b209-9ba9a113f198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273878832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f03708c-8d91-4a28-b040-850aa71640cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:14Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a9263e-c62e-4494-9606-802e8338dab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a9263e-c62e-4494-9606-802e8338dab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b389822a-0ce8-4ef2-ad71-54dd0a9a1852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b389822a-0ce8-4ef2-ad71-54dd0a9a1852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f03708c-8d91-4a28-b040-850aa71640cf', 'volume_name': 'volume-1f03708c-8d91-4a28-b040-850aa71640cf', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b56cdfc-e841-4198-8ed7-4877f1ae3fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b56cdfc-e841-4198-8ed7-4877f1ae3fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf3e0f0-ff73-429c-9d1f-160816d249fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:14 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Volume 1f03708c-8d91-4a28-b040-850aa71640cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f03708c-8d91-4a28-b040-850aa71640cf', 'volume_size': 1} Nov 03 17:20:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:15 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" returned: 0 in 7.754s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e, size 1024.00 MB, duration 7.76 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:20:15 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Converted 1024.00 MB image at 132.04 MB/s Nov 03 17:20:15 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a is being set with open permissions: ugo+rw Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:15 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a Nov 03 17:20:15 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:15 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" returned: 0 in 0.260s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" released by "_copy_volume_from_snapshot" :: held 8.985s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-241ad754-7929-4a3c-8f29-6d36b474eadd-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" released by "_create_volume_from_snapshot" :: held 9.056s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.086s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.711s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1943672637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74a8769-1338-4a80-90da-2efe79f2d243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d13dc4135bc4f82916a4de9e797ffb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:06Z,use_quota=True,user_id='dcb713985213446db96dbb425e7b92ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Creating volume a74a8769-1338-4a80-90da-2efe79f2d243 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:15 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:15 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 1073741824 Nov 03 17:20:15 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d22f746-3781-49e6-9f7f-670eb59991e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a', 'volume_size': 1, 'snapshot_id': '241ad754-7929-4a3c-8f29-6d36b474eadd'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a490c010-8547-4ad2-987d-9051bc535647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:15 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Volume volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a (cdcb3501-089e-45b4-8c2b-28d0f8b0107a): created successfully Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a490c010-8547-4ad2-987d-9051bc535647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:15 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Flow 'volume_create_manager' (d711d3aa-100a-443a-bbc7-e99304c05b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:15 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-4dc40df4-a1fa-45f1-99fb-a9d36b895434 tempest-VolumeDependencyTests-520092410 None] Created volume successfully. Nov 03 17:20:16 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 1073741824" returned: 0 in 0.475s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:16 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 Nov 03 17:20:16 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "cinder-241ad754-7929-4a3c-8f29-6d36b474eadd-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-241ad754-7929-4a3c-8f29-6d36b474eadd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "cinder-quobyte-99eba4d9-33e7-4535-be21-43edf802761e" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-99eba4d9-33e7-4535-be21-43edf802761e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "cinder-quobyte-241ad754-7929-4a3c-8f29-6d36b474eadd" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-241ad754-7929-4a3c-8f29-6d36b474eadd" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Deleting offline snapshot 241ad754-7929-4a3c-8f29-6d36b474eadd of volume 99eba4d9-33e7-4535-be21-43edf802761e {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] snapshot_file for this snap is: volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[298f3dcc-9b9c-4572-b973-f7196ffc9392]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:16 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243" returned: 0 in 0.290s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.384s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273878832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f03708c-8d91-4a28-b040-850aa71640cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:14Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Creating volume 1f03708c-8d91-4a28-b040-850aa71640cf {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:16 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6388070d-30c3-49c4-929c-b1d39e0b0a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74a8769-1338-4a80-90da-2efe79f2d243', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1759873d-1327-489c-badc-1fe675ea0ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:16 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf 1073741824 Nov 03 17:20:16 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:16 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Volume volume-a74a8769-1338-4a80-90da-2efe79f2d243 (a74a8769-1338-4a80-90da-2efe79f2d243): created successfully Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1759873d-1327-489c-badc-1fe675ea0ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:16 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Flow 'volume_create_manager' (ceae67db-5642-4616-b94f-cc4332fe38cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:16 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-de43a8ca-e73c-41b0-bc9e-9ab42b85510b tempest-CinderUnicodeTest-110206952 None] Created volume successfully. Nov 03 17:20:16 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd Nov 03 17:20:16 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:17 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd" returned: 0 in 0.478s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99eba4d9-33e7-4535-be21-43edf802761e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[75606628-9882-4d92-9a31-57084770e165]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:17 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e Nov 03 17:20:17 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf 1073741824" returned: 0 in 0.681s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:17 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:17 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf Nov 03 17:20:17 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:17 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf" returned: 0 in 0.313s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.475s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf3e0f0-ff73-429c-9d1f-160816d249fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f03708c-8d91-4a28-b040-850aa71640cf', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429d1c26-d735-48b2-96d9-6302e1c7ed49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] Creating offline snapshot d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 of volume a74a8769-1338-4a80-90da-2efe79f2d243 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:20:17 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Volume volume-1f03708c-8d91-4a28-b040-850aa71640cf (1f03708c-8d91-4a28-b040-850aa71640cf): created successfully Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429d1c26-d735-48b2-96d9-6302e1c7ed49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (ccc6f156-8b6d-434b-ac4d-7230a7eb8993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8130e3-451e-43c3-b826-3780b3add433]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:17 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-bb9d9725-6645-4fe0-a345-bc70d45ec8e2 tempest-ProjectMemberTests-570738927 None] Created volume successfully. Nov 03 17:20:17 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e" returned: 0 in 0.699s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:17 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd Nov 03 17:20:17 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:17 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 Nov 03 17:20:17 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:18 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243" returned: 0 in 0.387s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:18 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 1G Nov 03 17:20:18 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:18 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd" returned: 0 in 0.402s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:18 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd Nov 03 17:20:18 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:18 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e.241ad754-7929-4a3c-8f29-6d36b474eadd" returned: 0 in 0.377s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-241ad754-7929-4a3c-8f29-6d36b474eadd" released by "_delete_snapshot" :: held 2.170s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-99eba4d9-33e7-4535-be21-43edf802761e" released by "delete_snapshot" :: held 2.232s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:18 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 1G" returned: 0 in 0.651s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a74a8769-1338-4a80-90da-2efe79f2d243 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:18 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a74a8769-1338-4a80-90da-2efe79f2d243 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 Nov 03 17:20:18 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Created reservations ['38062401-49f1-4069-8dae-ef9c6d55f7a0', '6e41deac-d205-4552-9e10-bf195e95466d', 'd0dba57e-a49c-4751-a73b-94918c6fe082', 'c5282da4-afad-4999-9cab-1970247dc814'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:18 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Delete snapshot completed successfully. Nov 03 17:20:18 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-4f009648-028f-4c10-82bb-d288cc28f8f7 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-241ad754-7929-4a3c-8f29-6d36b474eadd-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:19 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a74a8769-1338-4a80-90da-2efe79f2d243 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2" returned: 0 in 0.335s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:19 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 is being set with open permissions: ugo+rw Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:19 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 Nov 03 17:20:19 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:19 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2" returned: 0 in 0.255s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:19 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.info Nov 03 17:20:19 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "cinder-99eba4d9-33e7-4535-be21-43edf802761e-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-99eba4d9-33e7-4535-be21-43edf802761e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:19 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.info" returned: 0 in 0.270s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:19 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.info is being set with open permissions: ugo+rw Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:19 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.info Nov 03 17:20:19 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "cinder-quobyte-99eba4d9-33e7-4535-be21-43edf802761e" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-99eba4d9-33e7-4535-be21-43edf802761e" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7184cbd-f8d2-470e-88a1-ef88c3c77d53]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:19 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e Nov 03 17:20:19 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:19 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.info" returned: 0 in 0.248s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.154s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] Creating offline snapshot 9a1cdd81-233e-4949-bbbb-e75488fd4d20 of volume 1f03708c-8d91-4a28-b040-850aa71640cf {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:20:20 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-8568148a-5d53-46b6-b312-b12b0f3c99c8 tempest-CinderUnicodeTest-110206952 None] Create snapshot completed successfully Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e972d0-f56b-49de-bea8-27cb01b1673d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:20 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf Nov 03 17:20:20 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:20 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e" returned: 0 in 0.378s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:20 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e Nov 03 17:20:20 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Acquiring lock "cinder-d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Lock "cinder-d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Acquiring lock "cinder-quobyte-a74a8769-1338-4a80-90da-2efe79f2d243" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Lock "cinder-quobyte-a74a8769-1338-4a80-90da-2efe79f2d243" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Acquiring lock "cinder-quobyte-d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Lock "cinder-quobyte-d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Deleting offline snapshot d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 of volume a74a8769-1338-4a80-90da-2efe79f2d243 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:20:20 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] snapshot_file for this snap is: volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf" returned: 0 in 0.434s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c53181-0b6d-4df0-8df7-361d52b78e88]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:20 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 1G Nov 03 17:20:20 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:20 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-99eba4d9-33e7-4535-be21-43edf802761e" returned: 0 in 0.294s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-99eba4d9-33e7-4535-be21-43edf802761e" released by "delete_volume" :: held 0.758s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Created reservations ['16ab460e-3da9-447f-9fb6-02d11d445951', '9c80efdd-1c22-4f2a-9bb8-109e521a3754', 'a72e754c-955f-4e6c-aa2e-a2fdaa8d16b4', '0eb703b3-9752-403a-ac69-c49553cb2f9d'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:20 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 Nov 03 17:20:20 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:20 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:20 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "cinder-cdcb3501-089e-45b4-8c2b-28d0f8b0107a-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:20 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-cdcb3501-089e-45b4-8c2b-28d0f8b0107a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:21 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2" returned: 0 in 0.555s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a74a8769-1338-4a80-90da-2efe79f2d243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:20:21 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:21 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 1G" returned: 0 in 0.601s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.356s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f03708c-8d91-4a28-b040-850aa71640cf -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77472bb-b6c5-4cc1-837f-3ff8a3b38097]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:21 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f03708c-8d91-4a28-b040-850aa71640cf -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 Nov 03 17:20:21 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "cinder-quobyte-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Deleted volume successfully. Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" acquired by "delete_volume" :: waited 0.029s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a9ec3642-a34e-4211-abf1-46759d296383 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-99eba4d9-33e7-4535-be21-43edf802761e-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[268f78ce-7d7a-4346-a171-452465f54f7e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:21 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 Nov 03 17:20:21 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:21 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a Nov 03 17:20:21 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:21 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f03708c-8d91-4a28-b040-850aa71640cf -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20" returned: 0 in 0.352s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:21 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 is being set with open permissions: ugo+rw Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:21 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 Nov 03 17:20:21 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:21 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243" returned: 0 in 0.436s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:21 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 Nov 03 17:20:21 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:21 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" returned: 0 in 0.519s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:21 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20" returned: 0 in 0.303s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:21 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a Nov 03 17:20:21 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:21 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.info Nov 03 17:20:21 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:21 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2" returned: 0 in 0.407s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:21 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2 Nov 03 17:20:21 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:22 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" returned: 0 in 0.315s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:22 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-quobyte-cdcb3501-089e-45b4-8c2b-28d0f8b0107a" released by "delete_volume" :: held 0.905s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.info" returned: 0 in 0.277s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:22 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.info is being set with open permissions: ugo+rw Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:22 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.info Nov 03 17:20:22 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Created reservations ['87d7b38b-561f-41d6-8ed0-5d4a4474fdf7', '4509aacd-54ac-4ea7-a55f-104c158e01ed', 'b365382b-5d5c-4c08-aa37-6f2406e93217', '866b0224-c0df-43e0-8b84-f4fdd58ac36f'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:22 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243.d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2" returned: 0 in 0.283s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:22 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:22 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Lock "cinder-quobyte-d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2" released by "_delete_snapshot" :: held 1.817s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Lock "cinder-quobyte-a74a8769-1338-4a80-90da-2efe79f2d243" released by "delete_snapshot" :: held 1.844s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Created reservations ['d09b819e-8e1d-4723-9ffb-cbbb12f4c255', 'ef3b3e13-1337-45cc-9609-0840fe798362', 'd58076ca-2da6-44ad-a474-99d439cf3a49', '569866ba-a989-42c6-a4d6-a9522ad91a87'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:22 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.info" returned: 0 in 0.289s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-239175d6-40d6-4ad9-aeae-7acb24c70c96 tempest-ProjectMemberTests-570738927 None] Create snapshot completed successfully Nov 03 17:20:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Delete snapshot completed successfully. Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3c77d384-124d-41a1-9efa-fc8aec811edf tempest-CinderUnicodeTest-110206952 None] Lock "cinder-d8e2f120-6ca4-4a0b-9416-0a8d778cf5e2-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:22 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.254s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:22 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Deleted volume successfully. Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-017ad666-945c-461e-905e-da819af38142 tempest-VolumeDependencyTests-520092410 None] Lock "cinder-cdcb3501-089e-45b4-8c2b-28d0f8b0107a-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Acquiring lock "cinder-a74a8769-1338-4a80-90da-2efe79f2d243-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Lock "cinder-a74a8769-1338-4a80-90da-2efe79f2d243-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Acquiring lock "cinder-quobyte-a74a8769-1338-4a80-90da-2efe79f2d243" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Lock "cinder-quobyte-a74a8769-1338-4a80-90da-2efe79f2d243" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3603a0b-7ac1-4cf1-ac0f-f0a2fdf4a896]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:22 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 Nov 03 17:20:22 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-9a1cdd81-233e-4949-bbbb-e75488fd4d20-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Lock "cinder-9a1cdd81-233e-4949-bbbb-e75488fd4d20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-1f03708c-8d91-4a28-b040-850aa71640cf" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-1f03708c-8d91-4a28-b040-850aa71640cf" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-9a1cdd81-233e-4949-bbbb-e75488fd4d20" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-9a1cdd81-233e-4949-bbbb-e75488fd4d20" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Deleting offline snapshot 9a1cdd81-233e-4949-bbbb-e75488fd4d20 of volume 1f03708c-8d91-4a28-b040-850aa71640cf {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] snapshot_file for this snap is: volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:20:23 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb171f2e-be4a-4201-9280-9ad2f2ba3823]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243" returned: 0 in 0.422s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:23 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243 Nov 03 17:20:23 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:23 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 Nov 03 17:20:23 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:23 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a74a8769-1338-4a80-90da-2efe79f2d243" returned: 0 in 0.286s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Lock "cinder-quobyte-a74a8769-1338-4a80-90da-2efe79f2d243" released by "delete_volume" :: held 0.777s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Created reservations ['4b9f116c-5c42-488a-85f0-bf37cc120ad0', '36a9e629-6dc1-4706-ba3a-1cb1b48ea029', '89dfdac5-a6ee-4304-b8f0-cc2319870940', 'b1c6156b-020f-4e2a-9295-aab2936868f7'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:23 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20" returned: 0 in 0.463s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f03708c-8d91-4a28-b040-850aa71640cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fce573-894f-485b-8eed-5836533de146]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:23 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:23 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:23 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf Nov 03 17:20:23 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Acquiring lock "cinder-1b797605-8dc0-48c9-a2f6-926050f77dee-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Lock "cinder-1b797605-8dc0-48c9-a2f6-926050f77dee-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=300,cinder:SELECT=216,cinder:INSERT=79,cinder:DELETE=22 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Acquiring lock "cinder-quobyte-1b797605-8dc0-48c9-a2f6-926050f77dee" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Lock "cinder-quobyte-1b797605-8dc0-48c9-a2f6-926050f77dee" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ce633a-0514-4620-8155-6b3e1f814410]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:23 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.417s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Deleted volume successfully. Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e880e14f-0cdc-44ff-84f6-231f45c25ece tempest-CinderUnicodeTest-110206952 None] Lock "cinder-a74a8769-1338-4a80-90da-2efe79f2d243-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:24 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee Nov 03 17:20:24 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:24 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf" returned: 0 in 0.560s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:24 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 Nov 03 17:20:24 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:24 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee" returned: 0 in 0.465s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:24 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee Nov 03 17:20:24 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:24 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20" returned: 0 in 0.477s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:24 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20 Nov 03 17:20:24 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:24 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1b797605-8dc0-48c9-a2f6-926050f77dee" returned: 0 in 0.309s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Lock "cinder-quobyte-1b797605-8dc0-48c9-a2f6-926050f77dee" released by "delete_volume" :: held 0.847s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=220,cinder:UPDATE=284,cinder:INSERT=78,cinder:DELETE=30 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:20:24 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Created reservations ['0abe32b7-2feb-4c33-8458-4a899c55d474', 'd2a10d2d-37c3-40b4-9c3d-aec4e328f5c3', '82a01f3c-96e6-4935-a965-26260434e670', 'cf297b86-f66f-40c2-bf59-6b9940a27172'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:25 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf.9a1cdd81-233e-4949-bbbb-e75488fd4d20" returned: 0 in 0.406s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-9a1cdd81-233e-4949-bbbb-e75488fd4d20" released by "_delete_snapshot" :: held 2.106s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-1f03708c-8d91-4a28-b040-850aa71640cf" released by "delete_snapshot" :: held 2.157s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:25 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:25 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Created reservations ['b4c2b534-770b-4480-b8cc-02d17eb5523d', '3c3ef5fb-21c3-4ffd-84a3-b48fcd8b11b2', '1faacea5-7557-46ea-9cfe-ee788aec36d7', 'd56d0f2c-2832-45f0-b955-c1561a31d337'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Delete snapshot completed successfully. Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-753022e6-87e1-47e1-9b06-ab6b24486b2e tempest-ProjectMemberTests-570738927 None] Lock "cinder-9a1cdd81-233e-4949-bbbb-e75488fd4d20-delete_snapshot" released by "delete_snapshot" :: held 2.338s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:25 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.284s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:25 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Deleted volume successfully. Nov 03 17:20:25 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-924a087c-0325-442d-98f2-a5220a8c8334 tempest-CinderUnicodeTest-110206952 None] Lock "cinder-1b797605-8dc0-48c9-a2f6-926050f77dee-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-1f03708c-8d91-4a28-b040-850aa71640cf-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Lock "cinder-1f03708c-8d91-4a28-b040-850aa71640cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-1f03708c-8d91-4a28-b040-850aa71640cf" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-1f03708c-8d91-4a28-b040-850aa71640cf" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:26 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[b656761c-fba9-43fd-abe0-bd0c49d5fdfd]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:26 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf Nov 03 17:20:26 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:26 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf" returned: 0 in 0.413s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:26 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf Nov 03 17:20:26 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:27 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-1f03708c-8d91-4a28-b040-850aa71640cf" returned: 0 in 0.297s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-1f03708c-8d91-4a28-b040-850aa71640cf" released by "delete_volume" :: held 0.797s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Created reservations ['d00a1357-4f5d-4e9a-aa6b-638f16742823', '4191cb78-9674-47ef-a06d-9a737a24c6a8', '028bbf53-c3a0-4361-9b22-61d3d4a7fdeb', '3d0a639d-f2ba-4843-b8d9-0d3d5e0e3a6f'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:27 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:27 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:27 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.364s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Deleted volume successfully. Nov 03 17:20:27 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-48a5c3f9-f89e-43c3-af9c-2c831df1b896 tempest-ProjectMemberTests-570738927 None] Lock "cinder-1f03708c-8d91-4a28-b040-850aa71640cf-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (83e21cec-3dbf-424a-904a-fe6c43c1e4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969cb400-22f7-4eb9-8ca1-0f4f7c65b8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969cb400-22f7-4eb9-8ca1-0f4f7c65b8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1284926899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58e23f1-9f86-48ea-a317-1af2e685ac6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:28Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ad0074-ae9b-4651-bff1-dd3c941469f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ad0074-ae9b-4651-bff1-dd3c941469f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b030cc2f-b246-45fb-8ef0-fcdd11c5b2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b030cc2f-b246-45fb-8ef0-fcdd11c5b2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58e23f1-9f86-48ea-a317-1af2e685ac6a', 'volume_name': 'volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56561fff-e7d4-439f-90c9-df070a62e741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56561fff-e7d4-439f-90c9-df070a62e741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a76088-5957-463c-bc6b-d318acfb0833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:28 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Volume d58e23f1-9f86-48ea-a317-1af2e685ac6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a', 'volume_size': 1} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1284926899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58e23f1-9f86-48ea-a317-1af2e685ac6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:28Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Creating volume d58e23f1-9f86-48ea-a317-1af2e685ac6a {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:28 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:28 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a 1073741824 Nov 03 17:20:28 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:28 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a 1073741824" returned: 0 in 0.612s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Flow 'volume_create_manager' (cce64944-1a84-4839-bf25-20cc797e5015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e6f5c5-4673-4d7f-9c7f-ccebb0b0b92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e6f5c5-4673-4d7f-9c7f-ccebb0b0b92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1229301226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c36fe9-6254-40f8-a213-1cd531d33660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04e5efe73f41c080ad02a3876cd9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:29Z,use_quota=True,user_id='b952731f119449f39575b85eeb5b91cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:29 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a Nov 03 17:20:29 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fd8380-82a5-4aea-8dc8-27ef3527deb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fd8380-82a5-4aea-8dc8-27ef3527deb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaad0f4-f2a9-4a9b-a6b4-b5c2261272bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaad0f4-f2a9-4a9b-a6b4-b5c2261272bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c36fe9-6254-40f8-a213-1cd531d33660', 'volume_name': 'volume-a0c36fe9-6254-40f8-a213-1cd531d33660', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a05917d-aac1-48f5-9949-dccc73d35090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a05917d-aac1-48f5-9949-dccc73d35090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5a6045-aa84-4770-a29e-ceec2859ceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:29 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Volume a0c36fe9-6254-40f8-a213-1cd531d33660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c36fe9-6254-40f8-a213-1cd531d33660', 'volume_size': 1} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:29 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a" returned: 0 in 0.256s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.173s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1229301226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c36fe9-6254-40f8-a213-1cd531d33660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04e5efe73f41c080ad02a3876cd9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:29Z,use_quota=True,user_id='b952731f119449f39575b85eeb5b91cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Creating volume a0c36fe9-6254-40f8-a213-1cd531d33660 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:29 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a76088-5957-463c-bc6b-d318acfb0833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:29 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 1073741824 Nov 03 17:20:29 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47911a8-979c-49e2-a2e8-67f7621b0b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:29 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Volume volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a (d58e23f1-9f86-48ea-a317-1af2e685ac6a): created successfully Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47911a8-979c-49e2-a2e8-67f7621b0b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (83e21cec-3dbf-424a-904a-fe6c43c1e4ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:29 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f5a165eb-c24b-4099-b8c3-d923970258a7 tempest-ProjectMemberTests-570738927 None] Created volume successfully. Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:29 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:29 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:29 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 1073741824" returned: 0 in 0.569s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:30 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 Nov 03 17:20:30 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:30 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.327s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:20:30 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660" returned: 0 in 0.304s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5a6045-aa84-4770-a29e-ceec2859ceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c36fe9-6254-40f8-a213-1cd531d33660', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fd71b4-fcec-45c0-abd2-dc22e23a1bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:30 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Volume volume-a0c36fe9-6254-40f8-a213-1cd531d33660 (a0c36fe9-6254-40f8-a213-1cd531d33660): created successfully Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fd71b4-fcec-45c0-abd2-dc22e23a1bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Flow 'volume_create_manager' (cce64944-1a84-4839-bf25-20cc797e5015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-06239804-b065-413d-82c9-7ec840135fb8 tempest-ProjectReaderTests-1994209839 None] Created volume successfully. Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] Creating offline snapshot e9517974-1988-4cae-bc8e-0c795af9f51a of volume d58e23f1-9f86-48ea-a317-1af2e685ac6a {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f44028-ce72-49fa-940c-b332c1d5ba6d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:30 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a Nov 03 17:20:30 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:31 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a" returned: 0 in 0.435s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:31 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a 1G Nov 03 17:20:31 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:31 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a 1G" returned: 0 in 0.559s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:31 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a Nov 03 17:20:31 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:31 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a" returned: 0 in 0.309s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:31 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a is being set with open permissions: ugo+rw Nov 03 17:20:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:31 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a Nov 03 17:20:31 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:32 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a" returned: 0 in 0.255s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:32 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.info Nov 03 17:20:32 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:32 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.info" returned: 0 in 0.263s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:32 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.info is being set with open permissions: ugo+rw Nov 03 17:20:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:32 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.info Nov 03 17:20:32 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:32 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.info" returned: 0 in 0.308s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.393s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] Creating offline snapshot a4e9d452-0c56-4e53-846d-940a2c1bf9ed of volume a0c36fe9-6254-40f8-a213-1cd531d33660 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:20:32 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3292237d-5943-43cc-8481-18fb73ac8460 tempest-ProjectMemberTests-570738927 None] Create snapshot completed successfully Nov 03 17:20:32 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a7cb51-e398-422a-89e6-f5052dee5885]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:32 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 Nov 03 17:20:32 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:33 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660" returned: 0 in 0.442s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:33 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed 1G Nov 03 17:20:33 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:33 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed 1G" returned: 0 in 0.458s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0c36fe9-6254-40f8-a213-1cd531d33660 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:33 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0c36fe9-6254-40f8-a213-1cd531d33660 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed Nov 03 17:20:33 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-e9517974-1988-4cae-bc8e-0c795af9f51a-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Lock "cinder-e9517974-1988-4cae-bc8e-0c795af9f51a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-d58e23f1-9f86-48ea-a317-1af2e685ac6a" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-d58e23f1-9f86-48ea-a317-1af2e685ac6a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-e9517974-1988-4cae-bc8e-0c795af9f51a" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-e9517974-1988-4cae-bc8e-0c795af9f51a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Deleting offline snapshot e9517974-1988-4cae-bc8e-0c795af9f51a of volume d58e23f1-9f86-48ea-a317-1af2e685ac6a {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] snapshot_file for this snap is: volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5d5ce7-a70d-4e71-a4dc-2ca088d85313]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:34 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a Nov 03 17:20:34 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:34 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0c36fe9-6254-40f8-a213-1cd531d33660 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed" returned: 0 in 0.424s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:34 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed is being set with open permissions: ugo+rw Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:34 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed Nov 03 17:20:34 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:34 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a" returned: 0 in 0.459s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ead5218-3907-4eda-b19e-7ec4ba9a6513]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:34 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed" returned: 0 in 0.332s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:34 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.info Nov 03 17:20:34 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:34 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a Nov 03 17:20:34 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:34 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.info" returned: 0 in 0.319s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:34 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.info is being set with open permissions: ugo+rw Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:34 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.info Nov 03 17:20:34 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:34 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a" returned: 0 in 0.522s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:35 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a Nov 03 17:20:35 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:35 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.info" returned: 0 in 0.305s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:35 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-9e7ca424-7bed-44be-8775-2934e8ae2e1f tempest-ProjectReaderTests-1994209839 None] Create snapshot completed successfully Nov 03 17:20:35 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a" returned: 0 in 0.385s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:35 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a Nov 03 17:20:35 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:35 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a.e9517974-1988-4cae-bc8e-0c795af9f51a" returned: 0 in 0.263s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-e9517974-1988-4cae-bc8e-0c795af9f51a" released by "_delete_snapshot" :: held 1.785s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-d58e23f1-9f86-48ea-a317-1af2e685ac6a" released by "delete_snapshot" :: held 1.809s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Created reservations ['c555e6b7-9c03-4911-9c27-fc265604b0f9', '9322e2ea-f867-463e-a70f-459fcba5011f', 'fc8bc8c4-9067-4072-abaa-78504872e7ac', '69620fcb-90fe-4bd2-8e35-896b93d89453'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:35 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Delete snapshot completed successfully. Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cafe5335-d184-4076-9b20-0d2bf1083ce2 tempest-ProjectMemberTests-570738927 None] Lock "cinder-e9517974-1988-4cae-bc8e-0c795af9f51a-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-a4e9d452-0c56-4e53-846d-940a2c1bf9ed-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Lock "cinder-a4e9d452-0c56-4e53-846d-940a2c1bf9ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-a0c36fe9-6254-40f8-a213-1cd531d33660" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-a0c36fe9-6254-40f8-a213-1cd531d33660" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-a4e9d452-0c56-4e53-846d-940a2c1bf9ed" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-a4e9d452-0c56-4e53-846d-940a2c1bf9ed" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Deleting offline snapshot a4e9d452-0c56-4e53-846d-940a2c1bf9ed of volume a0c36fe9-6254-40f8-a213-1cd531d33660 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:20:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] snapshot_file for this snap is: volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[e522ccf0-57d8-4c33-97d7-fae7bdd21f1e]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-d58e23f1-9f86-48ea-a317-1af2e685ac6a-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-d58e23f1-9f86-48ea-a317-1af2e685ac6a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:36 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed Nov 03 17:20:36 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-d58e23f1-9f86-48ea-a317-1af2e685ac6a" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-d58e23f1-9f86-48ea-a317-1af2e685ac6a" acquired by "delete_volume" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b766900-b33c-49f6-9e3e-831d146ddb85]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:36 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a Nov 03 17:20:36 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:36 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed" returned: 0 in 0.461s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0c36fe9-6254-40f8-a213-1cd531d33660(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d505f72-e73e-4a6b-8b8e-8860d4bce324]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:36 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 Nov 03 17:20:36 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:36 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a" returned: 0 in 0.440s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:36 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a Nov 03 17:20:36 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:36 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:37 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d58e23f1-9f86-48ea-a317-1af2e685ac6a" returned: 0 in 0.305s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660" returned: 0 in 0.504s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-d58e23f1-9f86-48ea-a317-1af2e685ac6a" released by "delete_volume" :: held 0.818s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:37 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed Nov 03 17:20:37 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Created reservations ['602955db-510e-476d-95c2-52ab43e8c3f3', 'b1c29a00-2c40-4ede-84f4-07510f3213c8', 'a5d6a1e3-b5be-40df-96dd-cf6834e58b9e', '2703395f-dd17-4b67-ae46-85112a250721'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:37 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:37 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:37 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed" returned: 0 in 0.428s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:37 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed Nov 03 17:20:37 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:37 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.337s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:37 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Deleted volume successfully. Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-623e1e55-1de5-4a0a-b571-e9cb376c37a1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-d58e23f1-9f86-48ea-a317-1af2e685ac6a-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:37 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660.a4e9d452-0c56-4e53-846d-940a2c1bf9ed" returned: 0 in 0.333s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-a4e9d452-0c56-4e53-846d-940a2c1bf9ed" released by "_delete_snapshot" :: held 1.865s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-a0c36fe9-6254-40f8-a213-1cd531d33660" released by "delete_snapshot" :: held 1.902s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (f6503f6f-3541-4460-bbb5-46700004048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c281238f-49e2-47af-9ef8-34922bc01951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c281238f-49e2-47af-9ef8-34922bc01951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2041354501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1414522-c213-41c0-a9e0-a5b812f4bd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:38Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8dd95b7-8780-47b8-b6b2-b0bba259bf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8dd95b7-8780-47b8-b6b2-b0bba259bf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b842c0b5-2910-4e82-b3a8-ac01eae443d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b842c0b5-2910-4e82-b3a8-ac01eae443d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1414522-c213-41c0-a9e0-a5b812f4bd90', 'volume_name': 'volume-b1414522-c213-41c0-a9e0-a5b812f4bd90', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a307594-109f-41d6-8ab1-43f544fdee43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a307594-109f-41d6-8ab1-43f544fdee43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2fae8d-1632-4d9b-baa5-a3b3f30b2503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:37 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Volume b1414522-c213-41c0-a9e0-a5b812f4bd90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1414522-c213-41c0-a9e0-a5b812f4bd90', 'volume_size': 1} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2041354501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1414522-c213-41c0-a9e0-a5b812f4bd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:38Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Creating volume b1414522-c213-41c0-a9e0-a5b812f4bd90 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:37 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:38 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 1073741824 Nov 03 17:20:38 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Created reservations ['a2330af2-f2e3-4e4e-9657-437e911a1944', 'e58c5754-6e5b-413f-ad0c-49bc8e0aa5f7', '0165cbca-2eac-4d1e-9fb7-4e72ea665aaa', 'b33f7c5f-1b40-470a-aeea-bd4e5c050c6f'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:38 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Delete snapshot completed successfully. Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-16500870-c466-48f6-99c2-caddec3a8fbd tempest-ProjectReaderTests-1994209839 None] Lock "cinder-a4e9d452-0c56-4e53-846d-940a2c1bf9ed-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:38 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 1073741824" returned: 0 in 0.471s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:38 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 Nov 03 17:20:38 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:38 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90" returned: 0 in 0.254s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2fae8d-1632-4d9b-baa5-a3b3f30b2503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1414522-c213-41c0-a9e0-a5b812f4bd90', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e7ecd5-3e5e-4723-8ce0-fe494f7a24bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:38 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Volume volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 (b1414522-c213-41c0-a9e0-a5b812f4bd90): created successfully Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e7ecd5-3e5e-4723-8ce0-fe494f7a24bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:38 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (f6503f6f-3541-4460-bbb5-46700004048a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:38 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7a1c8b98-bcba-471c-bb09-2ecfdb1299ce tempest-ProjectMemberTests-570738927 None] Created volume successfully. Nov 03 17:20:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-a0c36fe9-6254-40f8-a213-1cd531d33660-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-a0c36fe9-6254-40f8-a213-1cd531d33660-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-a0c36fe9-6254-40f8-a213-1cd531d33660" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-a0c36fe9-6254-40f8-a213-1cd531d33660" acquired by "delete_volume" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:39 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2fc53e-b1e6-4c6e-8d52-805f031f747c]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:39 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 Nov 03 17:20:39 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:39 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660" returned: 0 in 0.399s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:39 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660 Nov 03 17:20:39 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:39 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a0c36fe9-6254-40f8-a213-1cd531d33660" returned: 0 in 0.281s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:39 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-a0c36fe9-6254-40f8-a213-1cd531d33660" released by "delete_volume" :: held 0.757s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Created reservations ['d8e8ecf1-b822-4ead-99e8-3144bf432651', '4b8e9d89-77b4-4969-9a1c-8b6f5fe6a56a', '20e8a741-f147-43b9-b035-a99c15100f4e', '7d4402ff-ebcd-466c-a933-88db549c037b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:40 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:40 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] Creating offline snapshot 126cdce5-3ff4-41a8-b5f9-7d46bf73430f of volume b1414522-c213-41c0-a9e0-a5b812f4bd90 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c70519f-d08d-434b-bb6e-fb31d04eca82]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:40 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 Nov 03 17:20:40 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:40 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.314s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:40 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Deleted volume successfully. Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-27aeda79-dd6d-4fe3-a6cd-b0fbc09d66b0 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-a0c36fe9-6254-40f8-a213-1cd531d33660-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:40 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90" returned: 0 in 0.514s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:40 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f 1G Nov 03 17:20:40 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Flow 'volume_create_manager' (3e3a2afa-58d0-4982-9bab-7d2d858189f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112e6294-671d-4854-9719-2f9e1ec5657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112e6294-671d-4854-9719-2f9e1ec5657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161085197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030c9a7f-8438-43b1-99c3-c34e17086c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04e5efe73f41c080ad02a3876cd9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:41Z,use_quota=True,user_id='b952731f119449f39575b85eeb5b91cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ca3ce2-2851-4b1f-88be-8db427b9988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ca3ce2-2851-4b1f-88be-8db427b9988e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a920eda1-3248-40e5-82ba-36e1653afa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a920eda1-3248-40e5-82ba-36e1653afa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030c9a7f-8438-43b1-99c3-c34e17086c82', 'volume_name': 'volume-030c9a7f-8438-43b1-99c3-c34e17086c82', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec66497-fe17-449e-8158-131329046eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec66497-fe17-449e-8158-131329046eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e5b18-b788-4412-82fc-249ad3fc83c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:40 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Volume 030c9a7f-8438-43b1-99c3-c34e17086c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030c9a7f-8438-43b1-99c3-c34e17086c82', 'volume_size': 1} Nov 03 17:20:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:41 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f 1G" returned: 0 in 0.478s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:41 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f Nov 03 17:20:41 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:41 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f" returned: 0 in 0.294s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:41 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f is being set with open permissions: ugo+rw Nov 03 17:20:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:41 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f Nov 03 17:20:41 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:41 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f" returned: 0 in 0.270s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:41 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.info Nov 03 17:20:41 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:42 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.info" returned: 0 in 0.275s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:42 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.info is being set with open permissions: ugo+rw Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:42 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.info Nov 03 17:20:42 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:42 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.info" returned: 0 in 0.262s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161085197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030c9a7f-8438-43b1-99c3-c34e17086c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04e5efe73f41c080ad02a3876cd9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:41Z,use_quota=True,user_id='b952731f119449f39575b85eeb5b91cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Creating volume 030c9a7f-8438-43b1-99c3-c34e17086c82 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:42 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:42 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 1073741824 Nov 03 17:20:42 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:42 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-705f3a0a-7fb6-4fe0-b2be-3b21554f59b0 tempest-ProjectMemberTests-570738927 None] Create snapshot completed successfully Nov 03 17:20:42 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 1073741824" returned: 0 in 0.472s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:42 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 Nov 03 17:20:42 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:43 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82" returned: 0 in 0.285s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e5b18-b788-4412-82fc-249ad3fc83c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030c9a7f-8438-43b1-99c3-c34e17086c82', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27c46e7-6167-4e69-b0f4-2378ac50de44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:43 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Volume volume-030c9a7f-8438-43b1-99c3-c34e17086c82 (030c9a7f-8438-43b1-99c3-c34e17086c82): created successfully Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27c46e7-6167-4e69-b0f4-2378ac50de44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Flow 'volume_create_manager' (3e3a2afa-58d0-4982-9bab-7d2d858189f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:43 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-68c03155-1b8f-4a68-97f0-32f3c1235577 tempest-ProjectReaderTests-1994209839 None] Created volume successfully. Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-126cdce5-3ff4-41a8-b5f9-7d46bf73430f-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Lock "cinder-126cdce5-3ff4-41a8-b5f9-7d46bf73430f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-b1414522-c213-41c0-a9e0-a5b812f4bd90" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-b1414522-c213-41c0-a9e0-a5b812f4bd90" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-126cdce5-3ff4-41a8-b5f9-7d46bf73430f" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-126cdce5-3ff4-41a8-b5f9-7d46bf73430f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Deleting offline snapshot 126cdce5-3ff4-41a8-b5f9-7d46bf73430f of volume b1414522-c213-41c0-a9e0-a5b812f4bd90 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] snapshot_file for this snap is: volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3d74da-3011-4e8a-8f67-ff14c7d895c8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:43 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f Nov 03 17:20:43 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:43 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f" returned: 0 in 0.415s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1414522-c213-41c0-a9e0-a5b812f4bd90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57b1489-0d2a-4724-8af0-90f1306f3281]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:44 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 Nov 03 17:20:44 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] Creating offline snapshot 2aa84e84-4c22-4b8f-816e-c02615e25880 of volume 030c9a7f-8438-43b1-99c3-c34e17086c82 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:20:44 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[01162441-57bf-4cdc-8ea6-50809ce9fe54]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:44 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90" returned: 0 in 0.439s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:44 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f Nov 03 17:20:44 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:44 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 Nov 03 17:20:44 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:44 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82" returned: 0 in 0.465s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:44 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 1G Nov 03 17:20:44 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:44 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f" returned: 0 in 0.466s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:44 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f Nov 03 17:20:44 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:45 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90.126cdce5-3ff4-41a8-b5f9-7d46bf73430f" returned: 0 in 0.333s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-126cdce5-3ff4-41a8-b5f9-7d46bf73430f" released by "_delete_snapshot" :: held 1.809s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:45 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 1G" returned: 0 in 0.490s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030c9a7f-8438-43b1-99c3-c34e17086c82 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-b1414522-c213-41c0-a9e0-a5b812f4bd90" released by "delete_snapshot" :: held 1.855s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:45 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030c9a7f-8438-43b1-99c3-c34e17086c82 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 Nov 03 17:20:45 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Created reservations ['f30678e8-bba3-4d21-a623-e24f23fc02f4', '4257bd4a-5e2a-42fc-b634-1fd9febeae13', 'e8504df3-f969-45a5-bcca-ffe73aa41b14', '61aed92a-886c-48c7-98e1-5a1870cd115d'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:45 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Delete snapshot completed successfully. Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d32679e-f13e-45dd-9df2-c9b08517d1bc tempest-ProjectMemberTests-570738927 None] Lock "cinder-126cdce5-3ff4-41a8-b5f9-7d46bf73430f-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:45 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-b1414522-c213-41c0-a9e0-a5b812f4bd90-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030c9a7f-8438-43b1-99c3-c34e17086c82 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880" returned: 0 in 0.334s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:45 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 is being set with open permissions: ugo+rw Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Lock "cinder-b1414522-c213-41c0-a9e0-a5b812f4bd90-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:45 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 Nov 03 17:20:45 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-b1414522-c213-41c0-a9e0-a5b812f4bd90" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-b1414522-c213-41c0-a9e0-a5b812f4bd90" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d965766-6a11-43ce-b2ce-3aab0740ba58]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:45 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880" returned: 0 in 0.305s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:45 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 Nov 03 17:20:45 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:45 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:45 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.info Nov 03 17:20:45 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:46 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90" returned: 0 in 0.438s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:46 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.info" returned: 0 in 0.283s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:46 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.info is being set with open permissions: ugo+rw Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:46 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90 Nov 03 17:20:46 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:46 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.info Nov 03 17:20:46 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:46 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b1414522-c213-41c0-a9e0-a5b812f4bd90" returned: 0 in 0.276s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:46 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.info" returned: 0 in 0.280s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-b1414522-c213-41c0-a9e0-a5b812f4bd90" released by "delete_volume" :: held 0.834s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:46 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6f0696e1-7813-4a30-a2f5-a6c7b52a7316 tempest-ProjectReaderTests-1994209839 None] Create snapshot completed successfully Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Created reservations ['20429abf-d6e8-4d87-8514-b83583fb7466', 'c98ee20b-c3c7-4c28-a50d-c7f6be8366a8', '60586b63-a87a-496c-aa26-b778db204471', 'cba3a866-cf34-48b8-809c-863b54c4fc7c'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:46 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:46 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:46 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:46 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.265s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:47 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Deleted volume successfully. Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-5e6efe39-ac22-4977-84ee-6c881b5e4ec6 tempest-ProjectMemberTests-570738927 None] Lock "cinder-b1414522-c213-41c0-a9e0-a5b812f4bd90-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (5df2aa6a-5242-46df-b0ea-c2816688cd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6937ac17-490a-4aeb-832b-0a3e61a5f812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6937ac17-490a-4aeb-832b-0a3e61a5f812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144517439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0309721c-52e8-4555-8a72-8fb78e1f4940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:47Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1689387-f151-41fd-abea-28a4b9a9ec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1689387-f151-41fd-abea-28a4b9a9ec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd862d10-0e25-4205-b6ed-c912b3f06018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd862d10-0e25-4205-b6ed-c912b3f06018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0309721c-52e8-4555-8a72-8fb78e1f4940', 'volume_name': 'volume-0309721c-52e8-4555-8a72-8fb78e1f4940', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2c5d81-7d6a-4001-9b1e-c2f51d2a4f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2c5d81-7d6a-4001-9b1e-c2f51d2a4f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb5914c-279f-4161-83c8-d946d8a470fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:47 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Volume 0309721c-52e8-4555-8a72-8fb78e1f4940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0309721c-52e8-4555-8a72-8fb78e1f4940', 'volume_size': 1} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144517439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0309721c-52e8-4555-8a72-8fb78e1f4940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:47Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Creating volume 0309721c-52e8-4555-8a72-8fb78e1f4940 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:47 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-2aa84e84-4c22-4b8f-816e-c02615e25880-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:47 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 1073741824 Nov 03 17:20:47 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Lock "cinder-2aa84e84-4c22-4b8f-816e-c02615e25880-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-030c9a7f-8438-43b1-99c3-c34e17086c82" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-030c9a7f-8438-43b1-99c3-c34e17086c82" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-2aa84e84-4c22-4b8f-816e-c02615e25880" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-2aa84e84-4c22-4b8f-816e-c02615e25880" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Deleting offline snapshot 2aa84e84-4c22-4b8f-816e-c02615e25880 of volume 030c9a7f-8438-43b1-99c3-c34e17086c82 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] snapshot_file for this snap is: volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd2fed1-fba5-4683-8d31-319705891467]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:47 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 Nov 03 17:20:47 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:47 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 1073741824" returned: 0 in 0.518s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:47 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880" returned: 0 in 0.414s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-030c9a7f-8438-43b1-99c3-c34e17086c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[56afa405-f1cb-4385-8b6d-6d2d0ff8ed25]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:47 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:48 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 Nov 03 17:20:48 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:48 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 Nov 03 17:20:48 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:48 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940" returned: 0 in 0.277s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb5914c-279f-4161-83c8-d946d8a470fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0309721c-52e8-4555-8a72-8fb78e1f4940', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25aef75-0be8-415f-b921-f46b7ed2fa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:48 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Volume volume-0309721c-52e8-4555-8a72-8fb78e1f4940 (0309721c-52e8-4555-8a72-8fb78e1f4940): created successfully Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25aef75-0be8-415f-b921-f46b7ed2fa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (5df2aa6a-5242-46df-b0ea-c2816688cd54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:48 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-73318ca1-7e3d-4e36-abca-8bd8c622a228 tempest-ProjectMemberTests-570738927 None] Created volume successfully. Nov 03 17:20:48 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82" returned: 0 in 0.401s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:48 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 Nov 03 17:20:48 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:48 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880" returned: 0 in 0.358s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:48 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:48 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880 Nov 03 17:20:48 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:49 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82.2aa84e84-4c22-4b8f-816e-c02615e25880" returned: 0 in 0.277s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-2aa84e84-4c22-4b8f-816e-c02615e25880" released by "_delete_snapshot" :: held 1.576s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-030c9a7f-8438-43b1-99c3-c34e17086c82" released by "delete_snapshot" :: held 1.602s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Created reservations ['2d5a4746-38af-4349-9972-8f312a36c641', 'bd9f51c6-9de5-4696-8d88-b714a28b940c', 'c4e3a2fb-4ed9-4f71-a041-d26a8ffd002c', 'f388c3ba-28a0-4899-ba3d-c44f34b057af'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:49 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Delete snapshot completed successfully. Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a59a2012-9d8b-435a-9b24-be146fa5c6ef tempest-ProjectReaderTests-1994209839 None] Lock "cinder-2aa84e84-4c22-4b8f-816e-c02615e25880-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-030c9a7f-8438-43b1-99c3-c34e17086c82-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] Creating offline snapshot eed0bbf6-f2e5-4516-8100-d17148d3f511 of volume 0309721c-52e8-4555-8a72-8fb78e1f4940 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Lock "cinder-030c9a7f-8438-43b1-99c3-c34e17086c82-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f6e37f-df6e-49d4-b470-8110265ad167]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-030c9a7f-8438-43b1-99c3-c34e17086c82" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-030c9a7f-8438-43b1-99c3-c34e17086c82" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5192146-92de-4279-836e-ed16af4ed19a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:49 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:49 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 Nov 03 17:20:49 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:50 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 Nov 03 17:20:50 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:50 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940" returned: 0 in 0.422s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:50 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 1G Nov 03 17:20:50 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:50 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82" returned: 0 in 0.396s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:50 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82 Nov 03 17:20:50 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:50 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-030c9a7f-8438-43b1-99c3-c34e17086c82" returned: 0 in 0.271s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-030c9a7f-8438-43b1-99c3-c34e17086c82" released by "delete_volume" :: held 0.746s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:50 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Created reservations ['1201e646-7bc7-4b90-8cc1-03e3bac4f384', 'de7dfa90-0749-4aea-9b01-8126a8771393', '0db60a3c-c468-4a5d-8a74-2d0dcca3b835', '33b42a8e-5dc6-4587-b5dd-b2e28eea7fbe'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 1G" returned: 0 in 0.458s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0309721c-52e8-4555-8a72-8fb78e1f4940 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:50 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0309721c-52e8-4555-8a72-8fb78e1f4940 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 Nov 03 17:20:50 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:50 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:50 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:50 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:51 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0309721c-52e8-4555-8a72-8fb78e1f4940 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511" returned: 0 in 0.374s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:51 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 is being set with open permissions: ugo+rw Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:51 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 Nov 03 17:20:51 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:51 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.357s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:51 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Deleted volume successfully. Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c479ab06-41b1-4898-91f9-9024b7607fbb tempest-ProjectReaderTests-1994209839 None] Lock "cinder-030c9a7f-8438-43b1-99c3-c34e17086c82-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:51 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511" returned: 0 in 0.298s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:51 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.info Nov 03 17:20:51 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Flow 'volume_create_manager' (4ae06028-dc9f-4795-bf17-fb31a9732080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53b92ce-8745-4b13-ac3f-1e5026cd8cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53b92ce-8745-4b13-ac3f-1e5026cd8cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-156625415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48313f35-98ec-42a2-9a10-008720986e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04e5efe73f41c080ad02a3876cd9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:51Z,use_quota=True,user_id='b952731f119449f39575b85eeb5b91cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81263a3-6145-4151-ba66-05b54a7add8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81263a3-6145-4151-ba66-05b54a7add8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb83d16d-55b9-46c1-9568-9bf8a8db9492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb83d16d-55b9-46c1-9568-9bf8a8db9492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48313f35-98ec-42a2-9a10-008720986e66', 'volume_name': 'volume-48313f35-98ec-42a2-9a10-008720986e66', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5867037-f392-421d-9db3-982327aff649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5867037-f392-421d-9db3-982327aff649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c0a653-cd59-4779-8e48-76484e6cfd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:51 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Volume 48313f35-98ec-42a2-9a10-008720986e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48313f35-98ec-42a2-9a10-008720986e66', 'volume_size': 1} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:51 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.info" returned: 0 in 0.288s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:51 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.info is being set with open permissions: ugo+rw Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:51 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.info Nov 03 17:20:51 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:51 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.info" returned: 0 in 0.298s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.434s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-156625415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48313f35-98ec-42a2-9a10-008720986e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04e5efe73f41c080ad02a3876cd9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:51Z,use_quota=True,user_id='b952731f119449f39575b85eeb5b91cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Creating volume 48313f35-98ec-42a2-9a10-008720986e66 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:51 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:20:51 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:52 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 1073741824 Nov 03 17:20:52 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:52 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f6208867-1beb-447b-805d-79c01f0e4ec1 tempest-ProjectMemberTests-570738927 None] Create snapshot completed successfully Nov 03 17:20:52 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 1073741824" returned: 0 in 0.484s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:52 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 Nov 03 17:20:52 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:52 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66" returned: 0 in 0.262s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c0a653-cd59-4779-8e48-76484e6cfd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48313f35-98ec-42a2-9a10-008720986e66', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8e6f59-143d-4ccb-8ac6-32f10699b957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:52 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Volume volume-48313f35-98ec-42a2-9a10-008720986e66 (48313f35-98ec-42a2-9a10-008720986e66): created successfully Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8e6f59-143d-4ccb-8ac6-32f10699b957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Flow 'volume_create_manager' (4ae06028-dc9f-4795-bf17-fb31a9732080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-eed0bbf6-f2e5-4516-8100-d17148d3f511-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:52 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-75e3bb15-010d-4523-bb2a-1d47cd3b6591 tempest-ProjectReaderTests-1994209839 None] Created volume successfully. Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Lock "cinder-eed0bbf6-f2e5-4516-8100-d17148d3f511-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-0309721c-52e8-4555-8a72-8fb78e1f4940" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-0309721c-52e8-4555-8a72-8fb78e1f4940" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-eed0bbf6-f2e5-4516-8100-d17148d3f511" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-eed0bbf6-f2e5-4516-8100-d17148d3f511" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Deleting offline snapshot eed0bbf6-f2e5-4516-8100-d17148d3f511 of volume 0309721c-52e8-4555-8a72-8fb78e1f4940 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] snapshot_file for this snap is: volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf73e947-0c0a-4318-84b8-86d828899a57]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:52 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:53 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 Nov 03 17:20:53 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:53 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511" returned: 0 in 0.463s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0309721c-52e8-4555-8a72-8fb78e1f4940(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:20:53 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[45268e7a-a554-42b6-852c-f6f089744ed2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:53 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 Nov 03 17:20:53 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:53 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] Creating offline snapshot 45bf0385-5e7c-4217-9357-27af43ffa0ef of volume 48313f35-98ec-42a2-9a10-008720986e66 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:20:53 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1073f9da-93b8-42d7-8884-890df44aefd3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:53 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:53 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 Nov 03 17:20:53 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940" returned: 0 in 0.508s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:53 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:54 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 Nov 03 17:20:54 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:54 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66" returned: 0 in 0.444s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:54 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef 1G Nov 03 17:20:54 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:54 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511" returned: 0 in 0.500s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:54 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511 Nov 03 17:20:54 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:54 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940.eed0bbf6-f2e5-4516-8100-d17148d3f511" returned: 0 in 0.338s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:54 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef 1G" returned: 0 in 0.567s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:54 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48313f35-98ec-42a2-9a10-008720986e66 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-eed0bbf6-f2e5-4516-8100-d17148d3f511" released by "_delete_snapshot" :: held 1.977s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:54 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-0309721c-52e8-4555-8a72-8fb78e1f4940" released by "delete_snapshot" :: held 2.008s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:54 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48313f35-98ec-42a2-9a10-008720986e66 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef Nov 03 17:20:54 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:54 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Created reservations ['d22bc27a-bd36-42b0-9e47-d3b7888f6b42', '5132ef30-21e8-4b25-8525-aad898921b75', '0cb96eb3-d51e-44c1-923c-7086cccb9a7a', 'f1d939ff-2aed-4802-b834-5f118fca8c9c'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:55 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Delete snapshot completed successfully. Nov 03 17:20:55 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-6eafe205-8cbe-4163-828f-e18e539b68c7 tempest-ProjectMemberTests-570738927 None] Lock "cinder-eed0bbf6-f2e5-4516-8100-d17148d3f511-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:55 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48313f35-98ec-42a2-9a10-008720986e66 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef" returned: 0 in 0.349s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:55 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef is being set with open permissions: ugo+rw Nov 03 17:20:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:55 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef Nov 03 17:20:55 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:55 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef" returned: 0 in 0.281s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:55 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.info Nov 03 17:20:55 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:55 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.info" returned: 0 in 0.301s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:55 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.info is being set with open permissions: ugo+rw Nov 03 17:20:55 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:55 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.info Nov 03 17:20:55 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-0309721c-52e8-4555-8a72-8fb78e1f4940-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-0309721c-52e8-4555-8a72-8fb78e1f4940-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:56 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.info" returned: 0 in 0.298s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-0309721c-52e8-4555-8a72-8fb78e1f4940" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-0309721c-52e8-4555-8a72-8fb78e1f4940" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:56 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-80779a63-812c-4a4e-af6f-c93446681c18 tempest-ProjectReaderTests-1994209839 None] Create snapshot completed successfully Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[67be7fe6-08d8-4cb4-8b05-0874b5f66316]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:56 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 Nov 03 17:20:56 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:56 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940" returned: 0 in 0.402s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:56 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940 Nov 03 17:20:56 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:56 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0309721c-52e8-4555-8a72-8fb78e1f4940" returned: 0 in 0.271s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:56 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-0309721c-52e8-4555-8a72-8fb78e1f4940" released by "delete_volume" :: held 0.755s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Created reservations ['8f3be813-9d15-44f5-bd99-54d4f3e59473', '9236ef1d-f55d-4d8d-bba0-efeb90c2b628', 'f73d5cca-2712-4754-9af3-5928b852288c', '6de2f270-1fc6-47c4-819e-62d762f1e320'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-45bf0385-5e7c-4217-9357-27af43ffa0ef-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-45bf0385-5e7c-4217-9357-27af43ffa0ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-48313f35-98ec-42a2-9a10-008720986e66" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-48313f35-98ec-42a2-9a10-008720986e66" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-45bf0385-5e7c-4217-9357-27af43ffa0ef" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-45bf0385-5e7c-4217-9357-27af43ffa0ef" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Deleting offline snapshot 45bf0385-5e7c-4217-9357-27af43ffa0ef of volume 48313f35-98ec-42a2-9a10-008720986e66 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] snapshot_file for this snap is: volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928b42a-16bd-4528-8c74-78eb838faa6f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:57 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:20:57 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:57 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef Nov 03 17:20:57 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:57 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.304s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:20:57 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Deleted volume successfully. Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-47f0bcc2-5013-4773-a5e9-74325ef8def1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-0309721c-52e8-4555-8a72-8fb78e1f4940-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:57 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef" returned: 0 in 0.509s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48313f35-98ec-42a2-9a10-008720986e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ae8171-3e19-4439-a5c0-353cea1d980f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:57 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 Nov 03 17:20:57 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (64625275-17ae-4a97-bc81-ee753eeb1114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620b0140-a732-4eaf-9f46-5cf960ec3bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620b0140-a732-4eaf-9f46-5cf960ec3bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661788676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f86e06e-0326-4a74-aef2-84d928f732af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:58Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190e6a31-6ec4-4215-8d74-54e61188305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190e6a31-6ec4-4215-8d74-54e61188305d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7277b454-0452-4156-91e2-f276d9733f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7277b454-0452-4156-91e2-f276d9733f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f86e06e-0326-4a74-aef2-84d928f732af', 'volume_name': 'volume-5f86e06e-0326-4a74-aef2-84d928f732af', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f91ec7-1cde-4685-8382-1b1843ccdc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f91ec7-1cde-4685-8382-1b1843ccdc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d15331-d43a-44b3-b1b6-f2b7217ec12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:58 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Volume 5f86e06e-0326-4a74-aef2-84d928f732af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f86e06e-0326-4a74-aef2-84d928f732af', 'volume_size': 1} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661788676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f86e06e-0326-4a74-aef2-84d928f732af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:20:58Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Creating volume 5f86e06e-0326-4a74-aef2-84d928f732af {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:20:58 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:58 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af 1073741824 Nov 03 17:20:58 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:58 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66" returned: 0 in 0.529s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:58 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef Nov 03 17:20:58 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:58 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af 1073741824" returned: 0 in 0.540s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:58 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af Nov 03 17:20:58 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:58 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef" returned: 0 in 0.453s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:20:58 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef Nov 03 17:20:58 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:20:58 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af" returned: 0 in 0.348s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d15331-d43a-44b3-b1b6-f2b7217ec12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f86e06e-0326-4a74-aef2-84d928f732af', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8563a988-ffdc-4cf7-8159-3c5ee842bf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:20:59 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Volume volume-5f86e06e-0326-4a74-aef2-84d928f732af (5f86e06e-0326-4a74-aef2-84d928f732af): created successfully Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8563a988-ffdc-4cf7-8159-3c5ee842bf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (64625275-17ae-4a97-bc81-ee753eeb1114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:20:59 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-cef0a9d5-06c9-44a2-9d85-732027dde47f tempest-ProjectMemberTests-570738927 None] Created volume successfully. Nov 03 17:20:59 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66.45bf0385-5e7c-4217-9357-27af43ffa0ef" returned: 0 in 0.386s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-45bf0385-5e7c-4217-9357-27af43ffa0ef" released by "_delete_snapshot" :: held 2.017s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-48313f35-98ec-42a2-9a10-008720986e66" released by "delete_snapshot" :: held 2.045s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Created reservations ['34f92ee2-60e6-43f0-b949-44e5e5bf3c60', '86785eb4-6eee-4b7a-968b-88e83ea3bec5', 'c2e2cfbc-c5b4-462c-bd07-2ea2473f2ceb', '2329b827-87bb-4934-9d0e-35dc84e17eca'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:20:59 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Delete snapshot completed successfully. Nov 03 17:20:59 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b3ae7ea0-8d47-4563-8d23-967d58fa9903 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-45bf0385-5e7c-4217-9357-27af43ffa0ef-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] Creating offline snapshot b92d0993-ec87-4105-80b4-d0e6d768d53e of volume 5f86e06e-0326-4a74-aef2-84d928f732af {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bd920f-bc0a-47b3-b7f1-1f069d727435]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-48313f35-98ec-42a2-9a10-008720986e66-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-48313f35-98ec-42a2-9a10-008720986e66-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-48313f35-98ec-42a2-9a10-008720986e66" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-48313f35-98ec-42a2-9a10-008720986e66" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:00 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af Nov 03 17:21:00 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5f4fd8-1a6c-4eb7-9c29-5f1922f336f8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:00 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 Nov 03 17:21:00 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:00 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af" returned: 0 in 0.426s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:00 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e 1G Nov 03 17:21:00 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:00 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66" returned: 0 in 0.424s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:00 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66 Nov 03 17:21:00 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:01 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:01 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e 1G" returned: 0 in 0.500s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f86e06e-0326-4a74-aef2-84d928f732af -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-48313f35-98ec-42a2-9a10-008720986e66" returned: 0 in 0.349s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:01 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f86e06e-0326-4a74-aef2-84d928f732af -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e Nov 03 17:21:01 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-48313f35-98ec-42a2-9a10-008720986e66" released by "delete_volume" :: held 0.860s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Created reservations ['a2b025ca-d2d7-4912-86f4-3dd621c78bd4', '539649e1-4161-41b8-a888-c1e3809c6723', 'bbcc9808-26e4-40d5-b91a-1155e5ad574d', 'd3f47c43-fe64-4154-829a-1a6f8c8e0a05'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:01 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:01 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:01 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f86e06e-0326-4a74-aef2-84d928f732af -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e" returned: 0 in 0.386s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:01 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e is being set with open permissions: ugo+rw Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:01 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e Nov 03 17:21:01 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:01 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.355s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:01 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Deleted volume successfully. Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-3a6d79e3-2027-429c-91d1-3dc93312edd9 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-48313f35-98ec-42a2-9a10-008720986e66-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:01 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e" returned: 0 in 0.318s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:01 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.info Nov 03 17:21:01 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Flow 'volume_create_manager' (950c65c0-a914-4352-8d8e-2dc1863902b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3706620b-bed7-4637-ae49-84cb29bf9878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3706620b-bed7-4637-ae49-84cb29bf9878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1166655686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0fb28ab-c5cb-4459-a461-fddb4e578333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04e5efe73f41c080ad02a3876cd9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:02Z,use_quota=True,user_id='b952731f119449f39575b85eeb5b91cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f309bad8-d603-4208-9806-22f8d23a23a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f309bad8-d603-4208-9806-22f8d23a23a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff86685-da5e-466b-b744-95b48808bf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff86685-da5e-466b-b744-95b48808bf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0fb28ab-c5cb-4459-a461-fddb4e578333', 'volume_name': 'volume-f0fb28ab-c5cb-4459-a461-fddb4e578333', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf1978c-54cd-4c49-8771-af7606624c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:02 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf1978c-54cd-4c49-8771-af7606624c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ae6851-ecfd-415f-8592-d476faa22a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:02 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Volume f0fb28ab-c5cb-4459-a461-fddb4e578333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0fb28ab-c5cb-4459-a461-fddb4e578333', 'volume_size': 1} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.info" returned: 0 in 0.288s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:02 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.info is being set with open permissions: ugo+rw Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:02 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.info Nov 03 17:21:02 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:02 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.info" returned: 0 in 0.247s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.271s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1166655686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0fb28ab-c5cb-4459-a461-fddb4e578333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04e5efe73f41c080ad02a3876cd9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:02Z,use_quota=True,user_id='b952731f119449f39575b85eeb5b91cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Creating volume f0fb28ab-c5cb-4459-a461-fddb4e578333 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:02 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:02 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 1073741824 Nov 03 17:21:02 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b44c517f-4d7d-4138-b83d-97a9bafea9a4 tempest-ProjectMemberTests-570738927 None] Create snapshot completed successfully Nov 03 17:21:02 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 1073741824" returned: 0 in 0.490s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:03 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 Nov 03 17:21:03 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:03 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333" returned: 0 in 0.302s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ae6851-ecfd-415f-8592-d476faa22a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0fb28ab-c5cb-4459-a461-fddb4e578333', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aceec990-ae41-4020-8087-5bfefa27014a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:03 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Volume volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 (f0fb28ab-c5cb-4459-a461-fddb4e578333): created successfully Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aceec990-ae41-4020-8087-5bfefa27014a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Flow 'volume_create_manager' (950c65c0-a914-4352-8d8e-2dc1863902b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-b92d0993-ec87-4105-80b4-d0e6d768d53e-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:03 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-0eaa3db1-1f5e-4c53-acbb-b5be98387fbc tempest-ProjectReaderTests-1994209839 None] Created volume successfully. Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-b92d0993-ec87-4105-80b4-d0e6d768d53e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-5f86e06e-0326-4a74-aef2-84d928f732af" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-5f86e06e-0326-4a74-aef2-84d928f732af" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-b92d0993-ec87-4105-80b4-d0e6d768d53e" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-b92d0993-ec87-4105-80b4-d0e6d768d53e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Deleting offline snapshot b92d0993-ec87-4105-80b4-d0e6d768d53e of volume 5f86e06e-0326-4a74-aef2-84d928f732af {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] snapshot_file for this snap is: volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b83c80d-4bb0-4894-9e73-76a8d32c9661]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:03 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e Nov 03 17:21:03 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:03 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e" returned: 0 in 0.392s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f86e06e-0326-4a74-aef2-84d928f732af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:21:03 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6847b4c-5c78-47fe-bff2-c97ca82569b2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:04 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af Nov 03 17:21:04 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] Creating offline snapshot bf16b041-702f-4371-b1f4-6897146dbd32 of volume f0fb28ab-c5cb-4459-a461-fddb4e578333 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e90d92-a7a3-4764-9cdd-98dfaf0f6e98]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:04 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af" returned: 0 in 0.531s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:04 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e Nov 03 17:21:04 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:04 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 Nov 03 17:21:04 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:04 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:04 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333" returned: 0 in 0.436s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e" returned: 0 in 0.432s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:04 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 1G Nov 03 17:21:04 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:04 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e Nov 03 17:21:04 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:05 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af.b92d0993-ec87-4105-80b4-d0e6d768d53e" returned: 0 in 0.322s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-b92d0993-ec87-4105-80b4-d0e6d768d53e" released by "_delete_snapshot" :: held 1.805s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-5f86e06e-0326-4a74-aef2-84d928f732af" released by "delete_snapshot" :: held 1.841s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Created reservations ['afaefb30-784b-4ad0-bd0c-26d731b479cd', '7d5481a5-5bdf-48ca-a2e7-ad161b9f8e73', 'f339e90f-c724-4013-907c-3a4b53ea301c', '368c1e46-6928-40eb-bfe9-5e29a28e7d33'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:05 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Delete snapshot completed successfully. Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-e58e5b93-1965-4827-83ed-20d0f39254e1 tempest-ProjectMemberTests-570738927 None] Lock "cinder-b92d0993-ec87-4105-80b4-d0e6d768d53e-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:05 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 1G" returned: 0 in 0.581s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:05 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 Nov 03 17:21:05 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-5f86e06e-0326-4a74-aef2-84d928f732af-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Lock "cinder-5f86e06e-0326-4a74-aef2-84d928f732af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-5f86e06e-0326-4a74-aef2-84d928f732af" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-5f86e06e-0326-4a74-aef2-84d928f732af" acquired by "delete_volume" :: waited 0.037s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b6e50e-9295-4034-9621-898a7a977a3d]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:05 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32" returned: 0 in 0.406s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:05 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 is being set with open permissions: ugo+rw Nov 03 17:21:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:05 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af Nov 03 17:21:05 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:05 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 Nov 03 17:21:05 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:06 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32" returned: 0 in 0.332s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:06 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af" returned: 0 in 0.495s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:06 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af Nov 03 17:21:06 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:06 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.info Nov 03 17:21:06 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:06 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-5f86e06e-0326-4a74-aef2-84d928f732af" returned: 0 in 0.351s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:06 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.info" returned: 0 in 0.350s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:06 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.info is being set with open permissions: ugo+rw Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-5f86e06e-0326-4a74-aef2-84d928f732af" released by "delete_volume" :: held 0.949s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:06 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.info Nov 03 17:21:06 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Created reservations ['c6b2c8ce-4375-42ac-871d-01f48a3ad7d3', '2b29fbda-549e-4df1-b5af-7dff2bde326b', '9b0bfedd-27d0-499f-bb55-c3916090ad06', 'c0548c56-5d89-4700-a3a5-b28165b0dedb'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:06 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:06 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:07 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.info" returned: 0 in 0.386s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:07 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2a81efc5-b8eb-4b3f-ba13-0e65698eb570 tempest-ProjectReaderTests-1994209839 None] Create snapshot completed successfully Nov 03 17:21:07 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.291s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:07 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Deleted volume successfully. Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d343c3f6-a4a6-42aa-b582-211f84c57f9c tempest-ProjectMemberTests-570738927 None] Lock "cinder-5f86e06e-0326-4a74-aef2-84d928f732af-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-bf16b041-702f-4371-b1f4-6897146dbd32-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-bf16b041-702f-4371-b1f4-6897146dbd32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-f0fb28ab-c5cb-4459-a461-fddb4e578333" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-f0fb28ab-c5cb-4459-a461-fddb4e578333" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-bf16b041-702f-4371-b1f4-6897146dbd32" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-bf16b041-702f-4371-b1f4-6897146dbd32" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Deleting offline snapshot bf16b041-702f-4371-b1f4-6897146dbd32 of volume f0fb28ab-c5cb-4459-a461-fddb4e578333 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] snapshot_file for this snap is: volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcec60b-eb51-450f-946a-45ff90d328f8]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:07 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:07 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 Nov 03 17:21:07 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:08 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32" returned: 0 in 0.432s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0fb28ab-c5cb-4459-a461-fddb4e578333(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[8478d81f-f263-476f-bb44-7115fd3e8472]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:08 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 Nov 03 17:21:08 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (ab7b03ae-e442-4b5a-a899-8d48a085cb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445a5816-1ec8-45dd-a288-33dcfb318fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445a5816-1ec8-45dd-a288-33dcfb318fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736285267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:09Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77290d9e-7e7f-4b42-a25f-24f0690291c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77290d9e-7e7f-4b42-a25f-24f0690291c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c95cfc8-2925-4293-9b82-e27deeb49c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c95cfc8-2925-4293-9b82-e27deeb49c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6', 'volume_name': 'volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccd50ff-3b66-4437-9a30-da32b0ab015d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccd50ff-3b66-4437-9a30-da32b0ab015d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a45d164-0808-402c-8450-239a896f8620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:08 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Volume fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6', 'volume_size': 1} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736285267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:09Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Creating volume fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:08 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:08 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 1073741824 Nov 03 17:21:08 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:08 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333" returned: 0 in 0.457s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:08 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:08 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 Nov 03 17:21:08 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:09 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:09 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32" returned: 0 in 0.466s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 1073741824" returned: 0 in 0.569s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:09 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32 Nov 03 17:21:09 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:09 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 Nov 03 17:21:09 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:09 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333.bf16b041-702f-4371-b1f4-6897146dbd32" returned: 0 in 0.320s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-bf16b041-702f-4371-b1f4-6897146dbd32" released by "_delete_snapshot" :: held 1.842s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-f0fb28ab-c5cb-4459-a461-fddb4e578333" released by "delete_snapshot" :: held 1.874s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:09 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6" returned: 0 in 0.284s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a45d164-0808-402c-8450-239a896f8620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc76ffe-169a-4220-9866-a62d4dd8fc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:09 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Volume volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 (fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6): created successfully Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc76ffe-169a-4220-9866-a62d4dd8fc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (ab7b03ae-e442-4b5a-a899-8d48a085cb58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-673bd336-a88f-4b7d-acd0-ff502d150721 tempest-ProjectMemberTests-570738927 None] Created volume successfully. Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Created reservations ['5582572a-1f3d-488c-b9cb-743a773dc799', 'c448e714-90ef-4cb3-a213-e75d0db68d75', 'f0447f64-dc7b-4059-9148-1bb516f36e4f', '3a38f1f8-4c67-468c-8c10-c698a1a1747f'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:09 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Delete snapshot completed successfully. Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d73708ef-b438-4207-a825-568dc054ce69 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-bf16b041-702f-4371-b1f4-6897146dbd32-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-f0fb28ab-c5cb-4459-a461-fddb4e578333-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-f0fb28ab-c5cb-4459-a461-fddb4e578333-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:09 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-f0fb28ab-c5cb-4459-a461-fddb4e578333" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-f0fb28ab-c5cb-4459-a461-fddb4e578333" acquired by "delete_volume" :: waited 0.023s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8ab200-63e5-4cfa-ab3b-ac160cff0482]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:10 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 Nov 03 17:21:10 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:10 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333" returned: 0 in 0.437s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:10 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333 Nov 03 17:21:10 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Flow 'volume_create_manager' (c7c839be-18ad-4b3e-b159-fe1ecfc5ebac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de34c6b7-02e9-4a22-8556-e258a1680cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de34c6b7-02e9-4a22-8556-e258a1680cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1496469669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6689da-c385-4563-b0d6-98b0cba8856c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e99646cbf841ef993476ef35333343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:11Z,use_quota=True,user_id='13a32c6b4bd54d2cabeba8d1a96fc935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb4b924-00fa-4d34-9aab-f9e09cde0a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb4b924-00fa-4d34-9aab-f9e09cde0a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d3ef9a-daac-4ff8-be91-e44926ae5296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d3ef9a-daac-4ff8-be91-e44926ae5296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6689da-c385-4563-b0d6-98b0cba8856c', 'volume_name': 'volume-fe6689da-c385-4563-b0d6-98b0cba8856c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86229165-2fd5-4d86-8044-b3df236a098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86229165-2fd5-4d86-8044-b3df236a098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91430db4-cdab-4886-b8ad-64b3f6f83406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:10 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Volume fe6689da-c385-4563-b0d6-98b0cba8856c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6689da-c385-4563-b0d6-98b0cba8856c', 'volume_size': 1} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1496469669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6689da-c385-4563-b0d6-98b0cba8856c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e99646cbf841ef993476ef35333343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:11Z,use_quota=True,user_id='13a32c6b4bd54d2cabeba8d1a96fc935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Creating volume fe6689da-c385-4563-b0d6-98b0cba8856c {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:10 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:10 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f0fb28ab-c5cb-4459-a461-fddb4e578333" returned: 0 in 0.293s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:10 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c 1073741824 Nov 03 17:21:10 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-f0fb28ab-c5cb-4459-a461-fddb4e578333" released by "delete_volume" :: held 0.828s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Created reservations ['9ce821be-3c5c-4ad6-9ca0-b06311f3c6cd', '51383f5c-07a6-4369-940b-ad438e73e576', '714f9c82-ca04-43b2-8189-be5103ff3c77', '8ec4239c-b1c9-4d3c-ab99-ed90ab9574c1'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:10 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:11 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:11 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:11 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c 1073741824" returned: 0 in 0.502s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:11 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.284s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:11 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Deleted volume successfully. Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-323f861a-7bab-4164-925b-a2088415f533 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-f0fb28ab-c5cb-4459-a461-fddb4e578333-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:11 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c Nov 03 17:21:11 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:11 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c" returned: 0 in 0.258s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.630s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Flow 'volume_create_manager' (795adcf4-63ab-427c-be03-427e3273e336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1594625-f060-4d00-bf0b-e325cce4d601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91430db4-cdab-4886-b8ad-64b3f6f83406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6689da-c385-4563-b0d6-98b0cba8856c', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca4ad23-7dc0-4bd2-b060-1475bc4c72b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] Creating offline snapshot c7c97e25-7b56-4f6b-8e28-16fbd836d211 of volume fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1594625-f060-4d00-bf0b-e325cce4d601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007585926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fdfbded-6857-429e-abd5-3ab1a3b39929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04e5efe73f41c080ad02a3876cd9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:12Z,use_quota=True,user_id='b952731f119449f39575b85eeb5b91cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9188ead9-7624-407e-9f86-58dabf1a7614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9188ead9-7624-407e-9f86-58dabf1a7614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7424ba2-dbe3-4362-85a2-01abac160c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7424ba2-dbe3-4362-85a2-01abac160c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fdfbded-6857-429e-abd5-3ab1a3b39929', 'volume_name': 'volume-4fdfbded-6857-429e-abd5-3ab1a3b39929', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a56226-5c2d-4d20-977c-aa357b3cca83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a56226-5c2d-4d20-977c-aa357b3cca83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e84e48e-f71c-4cf4-a631-97745492e0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:11 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Volume 4fdfbded-6857-429e-abd5-3ab1a3b39929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fdfbded-6857-429e-abd5-3ab1a3b39929', 'volume_size': 1} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c006113-6d39-4760-b13e-28d284a9f163]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:11 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Volume volume-fe6689da-c385-4563-b0d6-98b0cba8856c (fe6689da-c385-4563-b0d6-98b0cba8856c): created successfully Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca4ad23-7dc0-4bd2-b060-1475bc4c72b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:11 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Flow 'volume_create_manager' (c7c839be-18ad-4b3e-b159-fe1ecfc5ebac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:11 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d9f92500-cdad-4cc7-9325-f36fa6d7cab0 tempest-SnapshotDependencyTests-1196426556 None] Created volume successfully. Nov 03 17:21:11 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 Nov 03 17:21:11 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:12 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6" returned: 0 in 0.387s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:12 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 1G Nov 03 17:21:12 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:12 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 1G" returned: 0 in 0.413s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:12 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 Nov 03 17:21:12 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:12 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211" returned: 0 in 0.326s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:12 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 is being set with open permissions: ugo+rw Nov 03 17:21:12 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:12 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 Nov 03 17:21:12 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:13 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211" returned: 0 in 0.293s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:13 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.info Nov 03 17:21:13 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:13 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.info" returned: 0 in 0.251s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:13 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.info is being set with open permissions: ugo+rw Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:13 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.info Nov 03 17:21:13 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:13 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.info" returned: 0 in 0.239s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.069s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007585926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fdfbded-6857-429e-abd5-3ab1a3b39929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04e5efe73f41c080ad02a3876cd9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:12Z,use_quota=True,user_id='b952731f119449f39575b85eeb5b91cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Creating volume 4fdfbded-6857-429e-abd5-3ab1a3b39929 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:13 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:21:13 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:13 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 1073741824 Nov 03 17:21:13 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:13 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6d0c6302-1018-46b4-9510-ec484881cf25 tempest-ProjectMemberTests-570738927 None] Create snapshot completed successfully Nov 03 17:21:14 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-c7c97e25-7b56-4f6b-8e28-16fbd836d211-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 1073741824" returned: 0 in 0.469s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Lock "cinder-c7c97e25-7b56-4f6b-8e28-16fbd836d211-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-c7c97e25-7b56-4f6b-8e28-16fbd836d211" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-c7c97e25-7b56-4f6b-8e28-16fbd836d211" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Deleting offline snapshot c7c97e25-7b56-4f6b-8e28-16fbd836d211 of volume fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] snapshot_file for this snap is: volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d893764-b358-4d5f-842e-af9a6761f3aa]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:14 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 Nov 03 17:21:14 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:14 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 Nov 03 17:21:14 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:14 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929" returned: 0 in 0.287s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.518s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e84e48e-f71c-4cf4-a631-97745492e0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fdfbded-6857-429e-abd5-3ab1a3b39929', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192fa717-440c-4a0c-a41a-e540a2419cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] Creating offline snapshot 287ca241-5807-4dde-aa77-e723f0646215 of volume fe6689da-c385-4563-b0d6-98b0cba8856c {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:21:14 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Volume volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 (4fdfbded-6857-429e-abd5-3ab1a3b39929): created successfully Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192fa717-440c-4a0c-a41a-e540a2419cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Flow 'volume_create_manager' (795adcf4-63ab-427c-be03-427e3273e336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb0498b-49b1-406a-b646-79ba5db98206]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:14 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c58af37e-8b12-4682-b53d-ec4a17740566 tempest-ProjectReaderTests-1994209839 None] Created volume successfully. Nov 03 17:21:14 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211" returned: 0 in 0.440s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[3579968e-d698-466a-af1d-fc0aabb8cbf3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:14 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:14 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c Nov 03 17:21:14 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:14 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 Nov 03 17:21:14 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:15 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c" returned: 0 in 0.452s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:15 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 1G Nov 03 17:21:15 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:15 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6" returned: 0 in 0.505s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:15 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 Nov 03 17:21:15 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:15 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 1G" returned: 0 in 0.424s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe6689da-c385-4563-b0d6-98b0cba8856c -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:15 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe6689da-c385-4563-b0d6-98b0cba8856c -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 Nov 03 17:21:15 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:15 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211" returned: 0 in 0.376s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:15 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211 Nov 03 17:21:15 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:15 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe6689da-c385-4563-b0d6-98b0cba8856c -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215" returned: 0 in 0.308s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:15 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 is being set with open permissions: ugo+rw Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:15 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 Nov 03 17:21:15 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:15 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6.c7c97e25-7b56-4f6b-8e28-16fbd836d211" returned: 0 in 0.277s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-c7c97e25-7b56-4f6b-8e28-16fbd836d211" released by "_delete_snapshot" :: held 1.741s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:15 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6" released by "delete_snapshot" :: held 1.770s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Created reservations ['cb246a6d-d189-4fbf-9979-1acc251ed40e', 'd8164210-36a0-48f7-bdbe-0d4ab5aaf3b1', '701282fc-f5a4-4af9-a00d-9167619fd2a6', 'c9264fd7-d64b-46ef-a594-d22337aa90d0'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:16 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Delete snapshot completed successfully. Nov 03 17:21:16 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215" returned: 0 in 0.279s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-1ada34c7-d789-45e9-b49b-64bbc344f182 tempest-ProjectMemberTests-570738927 None] Lock "cinder-c7c97e25-7b56-4f6b-8e28-16fbd836d211-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:16 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.info Nov 03 17:21:16 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Lock "cinder-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:16 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.info" returned: 0 in 0.295s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:16 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.info is being set with open permissions: ugo+rw Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:16 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.info Nov 03 17:21:16 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6" acquired by "delete_volume" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6b926e-18d8-4ae9-af47-5da27bfc90f2]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:16 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 Nov 03 17:21:16 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:16 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.info" returned: 0 in 0.262s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.662s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] Creating offline snapshot 165640af-ea85-4376-9409-d2dbddc0cd28 of volume 4fdfbded-6857-429e-abd5-3ab1a3b39929 {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:21:16 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ec02b41c-aaa1-4897-95fb-6e70f0f4f1de tempest-SnapshotDependencyTests-1196426556 None] Create snapshot completed successfully Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[18789090-e9ab-4273-b45b-853216e28e93]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:16 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:16 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 Nov 03 17:21:16 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6" returned: 0 in 0.416s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:16 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:16 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6 Nov 03 17:21:16 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:17 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:17 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929" returned: 0 in 0.443s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6" returned: 0 in 0.298s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:17 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 1G Nov 03 17:21:17 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6" released by "delete_volume" :: held 0.793s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Created reservations ['e098a83e-8d2f-429e-b86c-e95b2ac26e78', 'e74218a2-011f-4615-a665-2f8a79fa88a8', '8e8d2727-83b2-492c-806e-faeaa7e95768', 'ca9bad94-0a19-4ccb-9c57-e053e5dc579b'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:17 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:17 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:17 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 1G" returned: 0 in 0.530s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:17 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 Nov 03 17:21:17 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:17 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.340s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:17 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Deleted volume successfully. Nov 03 17:21:17 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-b906553d-9920-4da1-9a38-6104c49c3f0d tempest-ProjectMemberTests-570738927 None] Lock "cinder-fa8c7c45-d9d4-4226-966c-8e6dadb3c3c6-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Flow 'volume_create_manager' (4e026713-c748-490b-88db-12ff2b1e39ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d6e97a-9719-432b-813b-a5edfdc33a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d6e97a-9719-432b-813b-a5edfdc33a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666a20b2-fc54-4ae4-a243-d932570c13a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e99646cbf841ef993476ef35333343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=287ca241-5807-4dde-aa77-e723f0646215,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:18Z,use_quota=True,user_id='13a32c6b4bd54d2cabeba8d1a96fc935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de81cf2-4c51-47c3-8f0c-f2c4b2e416e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de81cf2-4c51-47c3-8f0c-f2c4b2e416e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca76ec4-5d31-4860-9a2b-9deaaa847d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca76ec4-5d31-4860-9a2b-9deaaa847d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '666a20b2-fc54-4ae4-a243-d932570c13a3', 'volume_name': 'volume-666a20b2-fc54-4ae4-a243-d932570c13a3', 'volume_size': 1, 'snapshot_id': '287ca241-5807-4dde-aa77-e723f0646215'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bc45c8-9421-46bf-b110-89b36b38ba3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bc45c8-9421-46bf-b110-89b36b38ba3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab7ba11-2ecf-4ced-9b8b-67c798df109e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:18 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Volume 666a20b2-fc54-4ae4-a243-d932570c13a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-666a20b2-fc54-4ae4-a243-d932570c13a3', 'volume_size': 1, 'snapshot_id': '287ca241-5807-4dde-aa77-e723f0646215'} Nov 03 17:21:18 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28" returned: 0 in 0.397s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:18 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 is being set with open permissions: ugo+rw Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:18 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 Nov 03 17:21:18 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:18 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28" returned: 0 in 0.262s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:18 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.info Nov 03 17:21:18 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:18 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.info" returned: 0 in 0.268s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:18 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.info is being set with open permissions: ugo+rw Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:18 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.info Nov 03 17:21:18 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:18 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:18 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.info" returned: 0 in 0.307s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.885s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "cinder-quobyte-287ca241-5807-4dde-aa77-e723f0646215-666a20b2-fc54-4ae4-a243-d932570c13a3" by "_create_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-287ca241-5807-4dde-aa77-e723f0646215-666a20b2-fc54-4ae4-a243-d932570c13a3" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Creating volume 666a20b2-fc54-4ae4-a243-d932570c13a3 from snapshot 287ca241-5807-4dde-aa77-e723f0646215 {{(pid=86661) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "cinder-quobyte-666a20b2-fc54-4ae4-a243-d932570c13a3" by "_copy_volume_from_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:19 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-4c3561cb-97ed-4a98-8db1-199c50261c53 tempest-ProjectReaderTests-1994209839 None] Create snapshot completed successfully Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-666a20b2-fc54-4ae4-a243-d932570c13a3" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] snapshot: 287ca241-5807-4dde-aa77-e723f0646215, volume: 666a20b2-fc54-4ae4-a243-d932570c13a3, {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fc204d-5c24-4a01-b7dd-b94003f99b61]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (8b3390d3-dd48-404a-869d-440ba7e22654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4cc68f-1596-4fbb-99ea-b7744c56593b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4cc68f-1596-4fbb-99ea-b7744c56593b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2136367497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6b2eb2-a23e-4477-ab17-54fd3db5d81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:19Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df16f7a-4835-459f-b80d-7c5de86fff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df16f7a-4835-459f-b80d-7c5de86fff26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68038a9-5a07-44b2-aeff-7c64e4dd0ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68038a9-5a07-44b2-aeff-7c64e4dd0ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6b2eb2-a23e-4477-ab17-54fd3db5d81a', 'volume_name': 'volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2faf91e3-4a17-433d-86b7-4bc0dc972e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2faf91e3-4a17-433d-86b7-4bc0dc972e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5c3635-0a93-4b5d-af41-cb6cd83835a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:19 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Volume 0d6b2eb2-a23e-4477-ab17-54fd3db5d81a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a', 'volume_size': 1} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-165640af-ea85-4376-9409-d2dbddc0cd28-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:19 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 Nov 03 17:21:19 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-165640af-ea85-4376-9409-d2dbddc0cd28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-4fdfbded-6857-429e-abd5-3ab1a3b39929" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-4fdfbded-6857-429e-abd5-3ab1a3b39929" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-165640af-ea85-4376-9409-d2dbddc0cd28" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-165640af-ea85-4376-9409-d2dbddc0cd28" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Deleting offline snapshot 165640af-ea85-4376-9409-d2dbddc0cd28 of volume 4fdfbded-6857-429e-abd5-3ab1a3b39929 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] snapshot_file for this snap is: volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6472ae23-405b-47b0-8f1c-35756a506ab3]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:19 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 Nov 03 17:21:19 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:19 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215" returned: 0 in 0.445s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe6689da-c385-4563-b0d6-98b0cba8856c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e41c97-e57b-4946-b417-786c7c88afc4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:19 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c Nov 03 17:21:19 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:19 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28" returned: 0 in 0.428s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fdfbded-6857-429e-abd5-3ab1a3b39929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7891a7-f3a8-4bf4-91af-bd8a63ad2515]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:19 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:19 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 Nov 03 17:21:19 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:20 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c" returned: 0 in 0.499s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 17:21:20 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Creating direct copy from snapshot {{(pid=86661) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 17:21:20 devstack cinder-volume[86661]: DEBUG cinder.utils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Path /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3 not found in is_blk_device check {{(pid=86661) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 17:21:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:20 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3 Nov 03 17:21:20 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:20 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929" returned: 0 in 0.481s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:20 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 Nov 03 17:21:20 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:20 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28" returned: 0 in 0.390s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:20 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:20 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28 Nov 03 17:21:20 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:21 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:21 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929.165640af-ea85-4376-9409-d2dbddc0cd28" returned: 0 in 0.576s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-165640af-ea85-4376-9409-d2dbddc0cd28" released by "_delete_snapshot" :: held 2.029s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-4fdfbded-6857-429e-abd5-3ab1a3b39929" released by "delete_snapshot" :: held 2.068s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:21 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Created reservations ['063926ea-0888-4f9b-97c9-fb6b14c3dac9', 'af29c0e1-b160-484c-9b39-a18a0f2bb5e0', 'ed8cc6be-257a-464d-b6c3-079501d6448d', '35f7fd3d-2993-4e7e-9def-60d3f8b467fc'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:21 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Delete snapshot completed successfully. Nov 03 17:21:21 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-afc7e57e-7d53-4f9b-944e-0ba58721a041 tempest-ProjectReaderTests-1994209839 None] Lock "cinder-165640af-ea85-4376-9409-d2dbddc0cd28-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-4fdfbded-6857-429e-abd5-3ab1a3b39929-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Lock "cinder-4fdfbded-6857-429e-abd5-3ab1a3b39929-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Acquiring lock "cinder-quobyte-4fdfbded-6857-429e-abd5-3ab1a3b39929" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:22 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-4fdfbded-6857-429e-abd5-3ab1a3b39929" acquired by "delete_volume" :: waited 0.027s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:22 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ac4583-dd1b-4747-a23c-599405afe3fc]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:22 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:22 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 Nov 03 17:21:22 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:23 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929" returned: 0 in 0.534s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:23 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929 Nov 03 17:21:23 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:23 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:23 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-4fdfbded-6857-429e-abd5-3ab1a3b39929" returned: 0 in 0.470s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:23 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Lock "cinder-quobyte-4fdfbded-6857-429e-abd5-3ab1a3b39929" released by "delete_volume" :: held 1.152s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:23 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Created reservations ['e68e74c7-bf41-471b-969f-05527c87b81a', 'cd9fb4a0-f384-4439-b91e-cc237d674cd2', '3bfe2620-c613-485b-b8dd-7e2f8e81ba46', '9c84252e-0743-4a29-a08c-157631adfb85'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:23 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:DELETE=18,cinder:SELECT=159,cinder:INSERT=59,cinder:UPDATE=203 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:21:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:24 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:24 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:24 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:24 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:24 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.317s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:24 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:24 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Deleted volume successfully. Nov 03 17:21:24 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-cb95a861-c4d6-4f2a-bcc6-ab59a2f1c7db tempest-ProjectReaderTests-1994209839 None] Lock "cinder-4fdfbded-6857-429e-abd5-3ab1a3b39929-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:26 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3" returned: 0 in 6.373s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.image.image_utils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Image conversion details: src /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3 {{(pid=86661) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 17:21:26 devstack cinder-volume[86661]: INFO cinder.image.image_utils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Converted 1024.00 MB image at 160.66 MB/s Nov 03 17:21:26 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3 is being set with open permissions: ugo+rw Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:26 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3 Nov 03 17:21:26 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:26 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3" returned: 0 in 0.279s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-666a20b2-fc54-4ae4-a243-d932570c13a3" released by "_copy_volume_from_snapshot" :: held 7.706s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=167,cinder:INSERT=55,cinder:UPDATE=212,cinder:DELETE=17 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-287ca241-5807-4dde-aa77-e723f0646215-666a20b2-fc54-4ae4-a243-d932570c13a3" released by "_create_volume_from_snapshot" :: held 7.814s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.839s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.584s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2136367497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6b2eb2-a23e-4477-ab17-54fd3db5d81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:19Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Creating volume 0d6b2eb2-a23e-4477-ab17-54fd3db5d81a {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:26 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:26 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a 1073741824 Nov 03 17:21:26 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab7ba11-2ecf-4ced-9b8b-67c798df109e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666a20b2-fc54-4ae4-a243-d932570c13a3', 'volume_size': 1, 'snapshot_id': '287ca241-5807-4dde-aa77-e723f0646215'}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ee9bf7-be08-4c64-a967-2bc7bec670fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:26 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Volume volume-666a20b2-fc54-4ae4-a243-d932570c13a3 (666a20b2-fc54-4ae4-a243-d932570c13a3): created successfully Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ee9bf7-be08-4c64-a967-2bc7bec670fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:26 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Flow 'volume_create_manager' (4e026713-c748-490b-88db-12ff2b1e39ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:26 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-d5601237-937b-4428-ad54-e0d46ae9f72b tempest-SnapshotDependencyTests-1196426556 None] Created volume successfully. Nov 03 17:21:27 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a 1073741824" returned: 0 in 0.510s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:27 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a Nov 03 17:21:27 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:27 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a" returned: 0 in 0.284s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:27 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:27 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5c3635-0a93-4b5d-af41-cb6cd83835a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5818ad45-482a-473d-86c5-ffb636c3e323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:27 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Volume volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a (0d6b2eb2-a23e-4477-ab17-54fd3db5d81a): created successfully Nov 03 17:21:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5818ad45-482a-473d-86c5-ffb636c3e323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:27 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (8b3390d3-dd48-404a-869d-440ba7e22654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:27 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-6ee13803-e810-4fc9-893a-7bb7139dc818 tempest-ProjectMemberTests-570738927 None] Created volume successfully. Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "cinder-287ca241-5807-4dde-aa77-e723f0646215-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-287ca241-5807-4dde-aa77-e723f0646215-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "cinder-quobyte-fe6689da-c385-4563-b0d6-98b0cba8856c" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-fe6689da-c385-4563-b0d6-98b0cba8856c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "cinder-quobyte-287ca241-5807-4dde-aa77-e723f0646215" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-287ca241-5807-4dde-aa77-e723f0646215" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Deleting offline snapshot 287ca241-5807-4dde-aa77-e723f0646215 of volume fe6689da-c385-4563-b0d6-98b0cba8856c {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] snapshot_file for this snap is: volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd431b9-faf4-4900-a284-16c58bae2227]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] Creating offline snapshot 29376f19-0feb-443e-9dd4-ec4b2d6244dc of volume 0d6b2eb2-a23e-4477-ab17-54fd3db5d81a {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f01ca50-07dd-425c-ad32-68c1fff56619]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:28 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 Nov 03 17:21:28 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:28 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a Nov 03 17:21:28 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:28 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215" returned: 0 in 0.458s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe6689da-c385-4563-b0d6-98b0cba8856c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:21:28 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a" returned: 0 in 0.415s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22c2753-8456-4ea4-8042-fc1b10c3c0d4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:28 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:28 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc 1G Nov 03 17:21:28 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:28 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c Nov 03 17:21:28 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:29 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc 1G" returned: 0 in 0.496s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:29 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc Nov 03 17:21:29 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:29 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c" returned: 0 in 0.608s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:29 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 Nov 03 17:21:29 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:29 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc" returned: 0 in 0.318s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:29 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc is being set with open permissions: ugo+rw Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:29 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc Nov 03 17:21:29 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:29 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215" returned: 0 in 0.380s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:29 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215 Nov 03 17:21:29 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:29 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc" returned: 0 in 0.301s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:29 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:29 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:29 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:29 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.info Nov 03 17:21:29 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:30 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c.287ca241-5807-4dde-aa77-e723f0646215" returned: 0 in 0.325s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:30 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.292s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-287ca241-5807-4dde-aa77-e723f0646215" released by "_delete_snapshot" :: held 1.970s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_service.periodic_task [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] Running periodic task VolumeManager._thread_info {{(pid=86661) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread count: 28 {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a060e288-fae8-4bde-8901-54488e6c21d3 None None] thread info: [<_MainThread(MainThread, started 133521455943808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86661) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-fe6689da-c385-4563-b0d6-98b0cba8856c" released by "delete_snapshot" :: held 2.019s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Flow 'volume_create_manager' (40918f33-b75d-4f04-96a3-fbe57bdb7bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabc6490-4857-4497-afaa-0dec384c6801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:30 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabc6490-4857-4497-afaa-0dec384c6801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-622985916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33dcc67-de73-4068-ad12-e64b69a8e473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78493c6e2a34886bb4929371d3946ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:30Z,use_quota=True,user_id='7c65b95f923c4521839a7194824a882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db13183-ea13-423a-8633-735e130227f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db13183-ea13-423a-8633-735e130227f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3af0ac-5b03-4aa7-8ad3-dfa0399932e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3af0ac-5b03-4aa7-8ad3-dfa0399932e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f33dcc67-de73-4068-ad12-e64b69a8e473', 'volume_name': 'volume-f33dcc67-de73-4068-ad12-e64b69a8e473', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43692f00-612e-4f95-bbcc-3a2a158284c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43692f00-612e-4f95-bbcc-3a2a158284c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bef6768-cf09-426e-a171-9094d2331b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:30 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Volume f33dcc67-de73-4068-ad12-e64b69a8e473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f33dcc67-de73-4068-ad12-e64b69a8e473', 'volume_size': 1} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.info" returned: 0 in 0.379s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:30 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.info is being set with open permissions: ugo+rw Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:30 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.info Nov 03 17:21:30 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Created reservations ['a31fb529-5f8f-466b-8f34-ccb554a12219', '28b63170-1b99-4af9-81c5-5eb8ae491e69', '10b740bc-2854-4b91-8a68-509214180ada', '4a3579e6-094b-4563-852f-31a55576c818'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Delete snapshot completed successfully. Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-ad4de0ba-f356-4703-b5cd-70cf96670f53 tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-287ca241-5807-4dde-aa77-e723f0646215-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:30 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.info" returned: 0 in 0.285s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.304s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.309s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-622985916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33dcc67-de73-4068-ad12-e64b69a8e473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78493c6e2a34886bb4929371d3946ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:30Z,use_quota=True,user_id='7c65b95f923c4521839a7194824a882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Creating volume f33dcc67-de73-4068-ad12-e64b69a8e473 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:30 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:21:30 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:30 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473 1073741824 Nov 03 17:21:30 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:30 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-752a7c82-40f7-45af-9ed9-3759bcfa8589 tempest-ProjectMemberTests-570738927 None] Create snapshot completed successfully Nov 03 17:21:31 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473 1073741824" returned: 0 in 0.452s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:31 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473 Nov 03 17:21:31 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "cinder-fe6689da-c385-4563-b0d6-98b0cba8856c-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:31 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-fe6689da-c385-4563-b0d6-98b0cba8856c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473" returned: 0 in 0.263s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bef6768-cf09-426e-a171-9094d2331b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f33dcc67-de73-4068-ad12-e64b69a8e473', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c4c923-625d-41ad-8078-afa6847cc1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "cinder-quobyte-fe6689da-c385-4563-b0d6-98b0cba8856c" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:31 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Volume volume-f33dcc67-de73-4068-ad12-e64b69a8e473 (f33dcc67-de73-4068-ad12-e64b69a8e473): created successfully Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c4c923-625d-41ad-8078-afa6847cc1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Flow 'volume_create_manager' (40918f33-b75d-4f04-96a3-fbe57bdb7bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-fe6689da-c385-4563-b0d6-98b0cba8856c" acquired by "delete_volume" :: waited 0.035s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:31 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-35a74589-a486-4bd0-a199-17717bce8003 tempest-ProjectReaderTests-1592901738 None] Created volume successfully. Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbb80f0-2e13-421a-b5b1-8514ebbaf060]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-29376f19-0feb-443e-9dd4-ec4b2d6244dc-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Lock "cinder-29376f19-0feb-443e-9dd4-ec4b2d6244dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-29376f19-0feb-443e-9dd4-ec4b2d6244dc" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-29376f19-0feb-443e-9dd4-ec4b2d6244dc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Deleting offline snapshot 29376f19-0feb-443e-9dd4-ec4b2d6244dc of volume 0d6b2eb2-a23e-4477-ab17-54fd3db5d81a {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] snapshot_file for this snap is: volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc76a4ef-ad0a-4c62-a738-61e988bb1816]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:31 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c Nov 03 17:21:31 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:31 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc Nov 03 17:21:31 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:31 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c" returned: 0 in 0.374s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:31 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c Nov 03 17:21:31 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:31 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc" returned: 0 in 0.380s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc98e469-8198-4710-b030-2794312060bb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:31 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:32 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a Nov 03 17:21:32 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:32 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-fe6689da-c385-4563-b0d6-98b0cba8856c" returned: 0 in 0.271s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-fe6689da-c385-4563-b0d6-98b0cba8856c" released by "delete_volume" :: held 0.715s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Created reservations ['d90be59b-0bed-41bb-abdc-979e6e5bdec6', 'da105f0d-465f-4564-b77b-8e0bff5b169a', '313661e2-bee7-4494-bc34-4dcdf7e77e94', '7d6262b9-b5a7-4dcd-b9ef-e5cb7740778a'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:32 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:32 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Acquiring lock "cinder-f33dcc67-de73-4068-ad12-e64b69a8e473-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Lock "cinder-f33dcc67-de73-4068-ad12-e64b69a8e473-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:32 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Acquiring lock "cinder-quobyte-f33dcc67-de73-4068-ad12-e64b69a8e473" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a" returned: 0 in 0.473s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:32 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc Nov 03 17:21:32 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "cinder-666a20b2-fc54-4ae4-a243-d932570c13a3-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Lock "cinder-quobyte-f33dcc67-de73-4068-ad12-e64b69a8e473" acquired by "delete_volume" :: waited 0.042s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-666a20b2-fc54-4ae4-a243-d932570c13a3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e278b1-a7c9-44e4-88b4-afe62fe5bc4a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "cinder-quobyte-666a20b2-fc54-4ae4-a243-d932570c13a3" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-666a20b2-fc54-4ae4-a243-d932570c13a3" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:32 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.381s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:32 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Deleted volume successfully. Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2593b1-25ee-4600-bbef-d214ab456e22]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-a918ee13-7766-42b2-9468-5562c94116fa tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-fe6689da-c385-4563-b0d6-98b0cba8856c-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:32 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473 Nov 03 17:21:32 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:32 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3 Nov 03 17:21:32 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:32 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc" returned: 0 in 0.405s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:32 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:32 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc Nov 03 17:21:32 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:33 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473" returned: 0 in 0.459s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:33 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473 Nov 03 17:21:33 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:33 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3" returned: 0 in 0.445s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:33 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3 Nov 03 17:21:33 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:33 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a.29376f19-0feb-443e-9dd4-ec4b2d6244dc" returned: 0 in 0.315s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-29376f19-0feb-443e-9dd4-ec4b2d6244dc" released by "_delete_snapshot" :: held 1.687s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a" released by "delete_snapshot" :: held 1.711s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:33 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-f33dcc67-de73-4068-ad12-e64b69a8e473" returned: 0 in 0.263s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Lock "cinder-quobyte-f33dcc67-de73-4068-ad12-e64b69a8e473" released by "delete_volume" :: held 0.831s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Created reservations ['69a031d4-d49b-449b-bdfe-8d3a4fc58734', 'a6a5dccd-5f0c-462d-9f75-5903ac8c443a', '18b94d5e-7d90-48e6-9272-645280f898a4', '99274212-2f89-4bc7-ae28-3d294e5bed3e'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Created reservations ['942ce5ca-bb30-4df0-b8a3-b36b750b80ed', 'f45808f3-5ef0-4810-b7b9-7d1ec914f9f0', 'af4d6cde-cbeb-4204-92e0-7455f6055df7', '18a7653f-12ff-4e9c-ba0b-9a8afcd38a0f'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:33 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Delete snapshot completed successfully. Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-666a20b2-fc54-4ae4-a243-d932570c13a3" returned: 0 in 0.314s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2214d83a-71d3-4140-835f-a8b48d2fad6e tempest-ProjectMemberTests-570738927 None] Lock "cinder-29376f19-0feb-443e-9dd4-ec4b2d6244dc-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-quobyte-666a20b2-fc54-4ae4-a243-d932570c13a3" released by "delete_volume" :: held 0.825s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:33 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:33 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Created reservations ['d8d850e2-4634-46e3-ae4e-2aaa8e7053e1', 'eb25836e-9c8a-4aab-a352-933728ea3ec2', '140ac85f-3814-4e53-a820-e289e760e0c2', '173b4eb7-f3e6-4fc0-833b-0160eb647c20'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:33 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:33 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Lock "cinder-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:33 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.354s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:33 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Deleted volume successfully. Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e88a45f-9194-467a-b3c0-929b2aa20f84]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-42a9046e-ea5c-4a41-8780-7ac3e29030fc tempest-ProjectReaderTests-1592901738 None] Lock "cinder-f33dcc67-de73-4068-ad12-e64b69a8e473-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:33 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.338s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:33 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:34 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Deleted volume successfully. Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-946d9a19-36ff-4da5-9e60-e8fa45c9132a tempest-SnapshotDependencyTests-1196426556 None] Lock "cinder-666a20b2-fc54-4ae4-a243-d932570c13a3-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:34 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a Nov 03 17:21:34 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Flow 'volume_create_manager' (56d419e2-39a8-474d-bd7c-8cfce0181080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8951779-a265-4801-a229-2edef7c6976c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8951779-a265-4801-a229-2edef7c6976c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466622665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55818777-5289-4c8d-9589-23a2b3e05e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78493c6e2a34886bb4929371d3946ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:34Z,use_quota=True,user_id='7c65b95f923c4521839a7194824a882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd18519-1c5b-43a1-8d82-341a22b9b27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd18519-1c5b-43a1-8d82-341a22b9b27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ebc51f-4f00-4397-b842-2937598888fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ebc51f-4f00-4397-b842-2937598888fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55818777-5289-4c8d-9589-23a2b3e05e88', 'volume_name': 'volume-55818777-5289-4c8d-9589-23a2b3e05e88', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2330ce3-788d-489c-b844-374dac235631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2330ce3-788d-489c-b844-374dac235631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f02f7b-52c3-4a5e-9749-18ff676a6340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:34 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Volume 55818777-5289-4c8d-9589-23a2b3e05e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55818777-5289-4c8d-9589-23a2b3e05e88', 'volume_size': 1} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466622665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55818777-5289-4c8d-9589-23a2b3e05e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78493c6e2a34886bb4929371d3946ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:34Z,use_quota=True,user_id='7c65b95f923c4521839a7194824a882e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Creating volume 55818777-5289-4c8d-9589-23a2b3e05e88 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:34 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:34 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88 1073741824 Nov 03 17:21:34 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:34 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a" returned: 0 in 0.386s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:34 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a Nov 03 17:21:34 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:34 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a" returned: 0 in 0.281s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a" released by "delete_volume" :: held 0.766s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:34 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88 1073741824" returned: 0 in 0.468s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Created reservations ['0a6604f5-29e4-49da-9f93-321acff05505', '9204b752-0dd0-4ad5-92db-b9c15b7338ba', '460744f4-f5f0-4b93-8062-c8c1311316f1', 'ec2beed3-4194-41c5-81a0-2694a91208c9'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:34 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88 Nov 03 17:21:34 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:34 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:34 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:34 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:35 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88" returned: 0 in 0.362s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f02f7b-52c3-4a5e-9749-18ff676a6340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55818777-5289-4c8d-9589-23a2b3e05e88', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10974843-2bc3-49f2-9a8b-f09784b62fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:35 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Volume volume-55818777-5289-4c8d-9589-23a2b3e05e88 (55818777-5289-4c8d-9589-23a2b3e05e88): created successfully Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10974843-2bc3-49f2-9a8b-f09784b62fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Flow 'volume_create_manager' (56d419e2-39a8-474d-bd7c-8cfce0181080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:35 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:35 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-14652ee4-cb90-42a6-963c-6b0557f6cb32 tempest-ProjectReaderTests-1592901738 None] Created volume successfully. Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.353s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:35 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Deleted volume successfully. Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-73f6757e-668a-4d79-a458-3bc9102ac117 tempest-ProjectMemberTests-570738927 None] Lock "cinder-0d6b2eb2-a23e-4477-ab17-54fd3db5d81a-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (b21489f4-a1c5-49db-b2c1-2b64e2636388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a36256-58c6-4058-ab6b-6cdd6d7fdfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a36256-58c6-4058-ab6b-6cdd6d7fdfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174654040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f764e5b-2283-44cd-9165-87e4b9af3b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:36Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7965588-768e-4b79-9549-9915df0fdf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7965588-768e-4b79-9549-9915df0fdf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d1171f-2046-4db3-9b46-6ba4a26c1b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d1171f-2046-4db3-9b46-6ba4a26c1b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f764e5b-2283-44cd-9165-87e4b9af3b2e', 'volume_name': 'volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef1ab3d-11c8-4014-8d99-8c2ecf68cee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef1ab3d-11c8-4014-8d99-8c2ecf68cee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18606f8-2ba5-45bb-841a-e9da63cc3d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:35 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Volume 3f764e5b-2283-44cd-9165-87e4b9af3b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e', 'volume_size': 1} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174654040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f764e5b-2283-44cd-9165-87e4b9af3b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c1271b6c2d4b15a47b7fca11f1c90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:36Z,use_quota=True,user_id='ba02b2a5540645b894ef1eef4e165399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Creating volume 3f764e5b-2283-44cd-9165-87e4b9af3b2e {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:35 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:21:35 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:35 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e 1073741824 Nov 03 17:21:35 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:36 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e 1073741824" returned: 0 in 0.468s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:36 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e Nov 03 17:21:36 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Acquiring lock "cinder-55818777-5289-4c8d-9589-23a2b3e05e88-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Lock "cinder-55818777-5289-4c8d-9589-23a2b3e05e88-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Acquiring lock "cinder-quobyte-55818777-5289-4c8d-9589-23a2b3e05e88" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Lock "cinder-quobyte-55818777-5289-4c8d-9589-23a2b3e05e88" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ea193c-6caa-400d-acff-5d17c0a7163b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:36 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e" returned: 0 in 0.289s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18606f8-2ba5-45bb-841a-e9da63cc3d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10aee58-bd29-451f-a712-064bc98de74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:36 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Volume volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e (3f764e5b-2283-44cd-9165-87e4b9af3b2e): created successfully Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10aee58-bd29-451f-a712-064bc98de74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Flow 'volume_create_manager' (b21489f4-a1c5-49db-b2c1-2b64e2636388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:36 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-05dae201-262c-4d8d-bf24-612855d84007 tempest-ProjectMemberTests-570738927 None] Created volume successfully. Nov 03 17:21:36 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88 Nov 03 17:21:36 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:36 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88" returned: 0 in 0.428s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:36 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:36 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88 Nov 03 17:21:36 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:37 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-55818777-5289-4c8d-9589-23a2b3e05e88" returned: 0 in 0.273s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Lock "cinder-quobyte-55818777-5289-4c8d-9589-23a2b3e05e88" released by "delete_volume" :: held 0.766s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Created reservations ['708aa8bc-a47a-4413-9c64-ffd39d1d7444', 'ba87a43f-bd34-44a0-b3cb-614df99112dc', '13875206-fc51-410c-9e43-5d147d39648d', '28a28d90-5850-4d4b-a466-92f0c001dd02'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:37 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:37 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:37 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.288s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:37 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Deleted volume successfully. Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-2bde0604-684a-47bd-b2c5-107d6739be0d tempest-ProjectReaderTests-1592901738 None] Lock "cinder-55818777-5289-4c8d-9589-23a2b3e05e88-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:37 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] Creating offline snapshot ccddf08a-1126-430f-96dd-bdc9d3664f66 of volume 3f764e5b-2283-44cd-9165-87e4b9af3b2e {{(pid=86661) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 17:21:38 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f6ea5b-b062-4f4b-912d-1d3ef6fa75e4]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:38 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e Nov 03 17:21:38 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:38 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e" returned: 0 in 0.402s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:38 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 1G {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:38 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 1G Nov 03 17:21:38 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:39 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 1G" returned: 0 in 0.630s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:39 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 Nov 03 17:21:39 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:39 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e -F qcow2 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66" returned: 0 in 0.341s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:39 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 is being set with open permissions: ugo+rw Nov 03 17:21:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:39 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 Nov 03 17:21:39 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:39 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66" returned: 0 in 0.294s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:39 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:39 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.info Nov 03 17:21:39 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:40 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.info" returned: 0 in 0.371s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:40 devstack cinder-volume[86661]: WARNING cinder.volume.drivers.remotefs [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.info is being set with open permissions: ugo+rw Nov 03 17:21:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.info {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:40 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.info Nov 03 17:21:40 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:40 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.info" returned: 0 in 0.257s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:40 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:40 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-5f01e651-ef4b-4bc5-8458-ed47d0e2dd26 tempest-ProjectMemberTests-570738927 None] Create snapshot completed successfully Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-ccddf08a-1126-430f-96dd-bdc9d3664f66-delete_snapshot" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Lock "cinder-ccddf08a-1126-430f-96dd-bdc9d3664f66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-3f764e5b-2283-44cd-9165-87e4b9af3b2e" by "delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-3f764e5b-2283-44cd-9165-87e4b9af3b2e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-ccddf08a-1126-430f-96dd-bdc9d3664f66" by "_delete_snapshot" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-ccddf08a-1126-430f-96dd-bdc9d3664f66" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Deleting offline snapshot ccddf08a-1126-430f-96dd-bdc9d3664f66 of volume 3f764e5b-2283-44cd-9165-87e4b9af3b2e {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] snapshot_file for this snap is: volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 {{(pid=86661) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a24df4-2228-408c-bb6f-6db09a7b3d21]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:41 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 Nov 03 17:21:41 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:41 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66" returned: 0 in 0.399s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86661) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e253e00-2e6f-4cad-a2cf-6293d3e73d2a]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:41 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:41 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e Nov 03 17:21:41 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:42 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e" returned: 0 in 0.448s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:42 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 Nov 03 17:21:42 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:42 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66" returned: 0 in 0.355s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:42 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66 Nov 03 17:21:42 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:42 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:42 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e.ccddf08a-1126-430f-96dd-bdc9d3664f66" returned: 0 in 0.281s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-ccddf08a-1126-430f-96dd-bdc9d3664f66" released by "_delete_snapshot" :: held 1.605s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:42 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-3f764e5b-2283-44cd-9165-87e4b9af3b2e" released by "delete_snapshot" :: held 1.631s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:42 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Created reservations ['8ab4cc0c-36a2-4a86-967f-4c787da4b0ab', 'b318a4ff-5785-4f8e-941e-881a074c0447', '31ef3f0c-7fc7-40b8-8e19-42ee1241948b', '11d715d5-a9e0-427b-bc70-10373973c29d'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:43 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Delete snapshot completed successfully. Nov 03 17:21:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-f23ab7a6-eaa9-4ccd-9612-44733fbcb46a tempest-ProjectMemberTests-570738927 None] Lock "cinder-ccddf08a-1126-430f-96dd-bdc9d3664f66-delete_snapshot" released by "delete_snapshot" :: held 1.771s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-3f764e5b-2283-44cd-9165-87e4b9af3b2e-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Lock "cinder-3f764e5b-2283-44cd-9165-87e4b9af3b2e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Acquiring lock "cinder-quobyte-3f764e5b-2283-44cd-9165-87e4b9af3b2e" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:43 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-3f764e5b-2283-44cd-9165-87e4b9af3b2e" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:43 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[373cf469-6e6b-4219-ad75-13b85574e50b]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:43 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e Nov 03 17:21:43 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:43 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e" returned: 0 in 0.404s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:43 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:43 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e Nov 03 17:21:43 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:44 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-3f764e5b-2283-44cd-9165-87e4b9af3b2e" returned: 0 in 0.260s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Lock "cinder-quobyte-3f764e5b-2283-44cd-9165-87e4b9af3b2e" released by "delete_volume" :: held 0.748s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Created reservations ['0fd6ba07-f183-475f-bc90-b99ba7b8fb96', 'fdcdb3c2-52e5-4612-af8d-46905e202186', 'ee648ec3-8484-48be-b486-181c2ddea311', '25223b07-08b7-48ec-bdb1-2defa68f7fb6'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:44 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:44 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:44 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.293s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:44 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Deleted volume successfully. Nov 03 17:21:44 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-35ac0cc1-ec70-4339-9b08-91c19dcc4191 tempest-ProjectMemberTests-570738927 None] Lock "cinder-3f764e5b-2283-44cd-9165-87e4b9af3b2e-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:54 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=56,cinder:INSERT=20,cinder:UPDATE=83,cinder:DELETE=7 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:21:54 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=60,cinder:UPDATE=79,cinder:INSERT=23,cinder:DELETE=6 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Flow 'volume_create_manager' (34332131-35fc-479e-96e6-9fb930276184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3a7c04-6c57-4b08-8fa5-b461726fc1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3a7c04-6c57-4b08-8fa5-b461726fc1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557113833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43764ad5-2924-46c4-a44d-a43983000d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88f7c10cd34496ea9f2a2fec4138c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:56Z,use_quota=True,user_id='8be8fa0c0bd942d7a022c6501a0e92b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa3ecba-e5d3-4a58-8b97-1733ef0e2b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa3ecba-e5d3-4a58-8b97-1733ef0e2b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9854d71-98e2-4068-8ec5-7cf2bf7d7a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9854d71-98e2-4068-8ec5-7cf2bf7d7a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43764ad5-2924-46c4-a44d-a43983000d71', 'volume_name': 'volume-43764ad5-2924-46c4-a44d-a43983000d71', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a333d1d7-8356-48e4-ab2d-d132acbff33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a333d1d7-8356-48e4-ab2d-d132acbff33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2f9690-ead6-4502-b94b-ebf6b92f9093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:56 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Volume 43764ad5-2924-46c4-a44d-a43983000d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43764ad5-2924-46c4-a44d-a43983000d71', 'volume_size': 1} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557113833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43764ad5-2924-46c4-a44d-a43983000d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88f7c10cd34496ea9f2a2fec4138c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:56Z,use_quota=True,user_id='8be8fa0c0bd942d7a022c6501a0e92b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Creating volume 43764ad5-2924-46c4-a44d-a43983000d71 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:56 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:56 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71 1073741824 Nov 03 17:21:56 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:56 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71 1073741824" returned: 0 in 0.462s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:56 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:56 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71 Nov 03 17:21:56 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:57 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71" returned: 0 in 0.250s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2f9690-ead6-4502-b94b-ebf6b92f9093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43764ad5-2924-46c4-a44d-a43983000d71', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04aed826-cd4f-4b2f-83ff-a254f2541e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:57 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Volume volume-43764ad5-2924-46c4-a44d-a43983000d71 (43764ad5-2924-46c4-a44d-a43983000d71): created successfully Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04aed826-cd4f-4b2f-83ff-a254f2541e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Flow 'volume_create_manager' (34332131-35fc-479e-96e6-9fb930276184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:57 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-a3348144-3db3-432d-b8e4-379ec308016d tempest-ProjectReaderTests-42216747 None] Created volume successfully. Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Acquiring lock "cinder-43764ad5-2924-46c4-a44d-a43983000d71-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Lock "cinder-43764ad5-2924-46c4-a44d-a43983000d71-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Acquiring lock "cinder-quobyte-43764ad5-2924-46c4-a44d-a43983000d71" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Lock "cinder-quobyte-43764ad5-2924-46c4-a44d-a43983000d71" acquired by "delete_volume" :: waited 0.018s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[05469b49-831e-4f64-a33a-8abd52dce488]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:57 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71 Nov 03 17:21:57 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:57 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71" returned: 0 in 0.383s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:57 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:58 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71 Nov 03 17:21:58 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:58 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-43764ad5-2924-46c4-a44d-a43983000d71" returned: 0 in 0.233s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Lock "cinder-quobyte-43764ad5-2924-46c4-a44d-a43983000d71" released by "delete_volume" :: held 0.661s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Created reservations ['d7ea0db9-42e6-47db-8a4a-8a52f3b0a4e9', '193c3c7f-9e0d-4904-96df-c781ff49b6f9', '2a29bc1a-bf46-4519-a564-11110bf3bcd4', 'db53d1a0-909a-41bd-a3a9-8ba2d3cd8718'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:58 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:21:58 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:58 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.234s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:21:58 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Deleted volume successfully. Nov 03 17:21:58 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-910a5a20-199e-4aac-8459-fcf8862dfb0b tempest-ProjectReaderTests-42216747 None] Lock "cinder-43764ad5-2924-46c4-a44d-a43983000d71-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Flow 'volume_create_manager' (6e8c91a1-044c-46d9-b0b1-152884d6ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92cd0cdb-633f-4cf8-bec0-ec2b00983d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92cd0cdb-633f-4cf8-bec0-ec2b00983d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487798926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88f7c10cd34496ea9f2a2fec4138c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:59Z,use_quota=True,user_id='8be8fa0c0bd942d7a022c6501a0e92b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35aea71e-1fbf-49a7-90e1-c2a24b28cb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35aea71e-1fbf-49a7-90e1-c2a24b28cb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0a19f6-9b71-4fc0-b992-d9a2e6be8a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0a19f6-9b71-4fc0-b992-d9a2e6be8a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7', 'volume_name': 'volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4694a113-f101-460d-9abd-601f67fb1e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4694a113-f101-460d-9abd-601f67fb1e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a736d5d-e12c-4ae9-a82d-4889819f5e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:59 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Volume a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7', 'volume_size': 1} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487798926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88f7c10cd34496ea9f2a2fec4138c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:21:59Z,use_quota=True,user_id='8be8fa0c0bd942d7a022c6501a0e92b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Creating volume a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:21:59 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:59 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7 1073741824 Nov 03 17:21:59 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:59 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7 1073741824" returned: 0 in 0.393s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:21:59 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7 Nov 03 17:21:59 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:21:59 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7" returned: 0 in 0.238s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a736d5d-e12c-4ae9-a82d-4889819f5e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d363bb-4302-4e00-a92e-ae1774ec70cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:21:59 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Volume volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7 (a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7): created successfully Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d363bb-4302-4e00-a92e-ae1774ec70cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:21:59 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Flow 'volume_create_manager' (6e8c91a1-044c-46d9-b0b1-152884d6ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:21:59 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b73295bc-1860-4538-bbe3-7027ce8f2f23 tempest-ProjectReaderTests-42216747 None] Created volume successfully. Nov 03 17:22:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Acquiring lock "cinder-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:22:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Lock "cinder-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:22:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Acquiring lock "cinder-quobyte-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:22:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Lock "cinder-quobyte-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7" acquired by "delete_volume" :: waited 0.016s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:22:00 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[53baaa0f-bfbc-45ce-b640-4667724e980f]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:22:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:00 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7 Nov 03 17:22:00 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:00 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7" returned: 0 in 0.373s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:00 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7 Nov 03 17:22:00 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:00 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:00 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7" returned: 0 in 0.253s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:00 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Lock "cinder-quobyte-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7" released by "delete_volume" :: held 0.666s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:22:00 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Created reservations ['4edf0863-7008-4ed3-af36-ee61add5c96d', '5b7db719-790a-4341-a271-efa6dfcd9ee8', 'b1854643-7f40-4098-ac03-28fab7dd74cf', '24a77d00-81a3-46a3-927b-a60bba7ad237'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:01 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:22:01 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:01 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.269s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:22:01 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Deleted volume successfully. Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-7d19c656-42ba-4d20-9949-117e2cdb68e3 tempest-ProjectReaderTests-42216747 None] Lock "cinder-a3a6aba8-a80f-4bae-b5d0-33cf3fe297f7-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Flow 'volume_create_manager' (1a60efac-283e-43cf-85ae-aac50cae634b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa3a84d-cbcc-42f3-88fc-89c6f00c542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa3a84d-cbcc-42f3-88fc-89c6f00c542a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823654998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e48db7-3abb-4880-9cee-5ae11dc9cb32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88f7c10cd34496ea9f2a2fec4138c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:02Z,use_quota=True,user_id='8be8fa0c0bd942d7a022c6501a0e92b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de93598-1844-4508-9b80-1f07316fed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de93598-1844-4508-9b80-1f07316fed0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3174c5d4-2618-4595-b799-ef33ccefb8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3174c5d4-2618-4595-b799-ef33ccefb8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4e48db7-3abb-4880-9cee-5ae11dc9cb32', 'volume_name': 'volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c059ae6-c480-4dbb-8958-2eda2cde4f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c059ae6-c480-4dbb-8958-2eda2cde4f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db3449d-9135-46a4-93a9-03b303441bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:01 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Volume d4e48db7-3abb-4880-9cee-5ae11dc9cb32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32', 'volume_size': 1} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823654998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e48db7-3abb-4880-9cee-5ae11dc9cb32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88f7c10cd34496ea9f2a2fec4138c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:02Z,use_quota=True,user_id='8be8fa0c0bd942d7a022c6501a0e92b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Creating volume d4e48db7-3abb-4880-9cee-5ae11dc9cb32 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:22:01 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:22:01 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:01 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32 1073741824 Nov 03 17:22:01 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:02 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32 1073741824" returned: 0 in 0.418s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:02 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32 Nov 03 17:22:02 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:02 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32" returned: 0 in 0.256s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db3449d-9135-46a4-93a9-03b303441bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b45b064-074d-4620-a046-f0c601d5d916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:02 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Volume volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32 (d4e48db7-3abb-4880-9cee-5ae11dc9cb32): created successfully Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b45b064-074d-4620-a046-f0c601d5d916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Flow 'volume_create_manager' (1a60efac-283e-43cf-85ae-aac50cae634b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:02 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-b6d9896e-269c-4435-b8b7-8798fcfa3573 tempest-ProjectReaderTests-42216747 None] Created volume successfully. Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Acquiring lock "cinder-d4e48db7-3abb-4880-9cee-5ae11dc9cb32-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Lock "cinder-d4e48db7-3abb-4880-9cee-5ae11dc9cb32-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Acquiring lock "cinder-quobyte-d4e48db7-3abb-4880-9cee-5ae11dc9cb32" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:22:02 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Lock "cinder-quobyte-d4e48db7-3abb-4880-9cee-5ae11dc9cb32" acquired by "delete_volume" :: waited 0.020s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff30799-c3d6-4293-853b-0a026dd1ff88]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:03 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32 Nov 03 17:22:03 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:03 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32" returned: 0 in 0.379s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:03 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32 Nov 03 17:22:03 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:03 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-d4e48db7-3abb-4880-9cee-5ae11dc9cb32" returned: 0 in 0.266s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Lock "cinder-quobyte-d4e48db7-3abb-4880-9cee-5ae11dc9cb32" released by "delete_volume" :: held 0.697s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Created reservations ['7efa4539-ed40-45f2-b332-bcc4f2b62b22', '99f47dc9-6040-472f-a7d0-b87f70b9d094', 'dfdcc30c-bf28-4a5d-ba3e-025a9b2946d1', '32b3fa3b-a046-4d40-b34d-0cbe0e646592'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:03 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:03 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:22:03 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:04 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.295s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:22:04 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Deleted volume successfully. Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-c0f807df-0c24-4bcc-adc0-50a369e4f710 tempest-ProjectReaderTests-42216747 None] Lock "cinder-d4e48db7-3abb-4880-9cee-5ae11dc9cb32-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.flows.manager.create_volume [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86661) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Flow 'volume_create_manager' (f959332c-a364-4a4f-97f9-ccc56ac1d645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee50bc8-3809-4887-b80b-f5361f39bc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee50bc8-3809-4887-b80b-f5361f39bc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193546700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18970ac-c29c-4f66-9603-0e98f1acc280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88f7c10cd34496ea9f2a2fec4138c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:04Z,use_quota=True,user_id='8be8fa0c0bd942d7a022c6501a0e92b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d9d768-9c58-4242-a02e-9d2e93d6bec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d9d768-9c58-4242-a02e-9d2e93d6bec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c0a297-9229-4fa1-9053-eee2a3d5e6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c0a297-9229-4fa1-9053-eee2a3d5e6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18970ac-c29c-4f66-9603-0e98f1acc280', 'volume_name': 'volume-b18970ac-c29c-4f66-9603-0e98f1acc280', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09bfef8-7119-42f9-8979-0e193462e221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09bfef8-7119-42f9-8979-0e193462e221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac3b9e4-933d-40e3-a572-b13a441e1a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:04 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Volume b18970ac-c29c-4f66-9603-0e98f1acc280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18970ac-c29c-4f66-9603-0e98f1acc280', 'volume_size': 1} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T16:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193546700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18970ac-c29c-4f66-9603-0e98f1acc280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88f7c10cd34496ea9f2a2fec4138c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T16:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T16:22:04Z,use_quota=True,user_id='8be8fa0c0bd942d7a022c6501a0e92b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebb124d0-b072-4337-ac36-3925cb347676),volume_type_id=ebb124d0-b072-4337-ac36-3925cb347676)}" {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.remotefs [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Creating volume b18970ac-c29c-4f66-9603-0e98f1acc280 {{(pid=86661) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Selected osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 as target Quobyte volume. {{(pid=86661) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 17:22:04 devstack cinder-volume[86661]: INFO cinder.volume.drivers.remotefs [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] casted to osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2 Nov 03 17:22:04 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280 1073741824 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:04 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280 1073741824 Nov 03 17:22:04 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:05 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280 1073741824" returned: 0 in 0.431s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:05 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280 Nov 03 17:22:05 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:05 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280" returned: 0 in 0.240s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'} {{(pid=86661) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac3b9e4-933d-40e3-a572-b13a441e1a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18970ac-c29c-4f66-9603-0e98f1acc280', 'volume_size': 1}' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538c0514-3353-48d7-b466-17da040c8550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 17:22:05 devstack cinder-volume[86661]: INFO cinder.volume.flows.manager.create_volume [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Volume volume-b18970ac-c29c-4f66-9603-0e98f1acc280 (b18970ac-c29c-4f66-9603-0e98f1acc280): created successfully Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538c0514-3353-48d7-b466-17da040c8550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86661) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Flow 'volume_create_manager' (f959332c-a364-4a4f-97f9-ccc56ac1d645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86661) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 17:22:05 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-03de0042-b753-4d69-9bdc-8f6ece376086 tempest-ProjectReaderTests-42216747 None] Created volume successfully. Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Acquiring lock "cinder-b18970ac-c29c-4f66-9603-0e98f1acc280-delete_volume" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Lock "cinder-b18970ac-c29c-4f66-9603-0e98f1acc280-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Acquiring lock "cinder-quobyte-b18970ac-c29c-4f66-9603-0e98f1acc280" by "delete_volume" {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Lock "cinder-quobyte-b18970ac-c29c-4f66-9603-0e98f1acc280" acquired by "delete_volume" :: waited 0.012s {{(pid=86661) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG oslo.privsep.daemon [-] privsep: reply[c653d58e-3b2c-43ed-af6e-9e4733f3afcb]: (4, 'qcow2') {{(pid=87670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 17:22:05 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:05 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280 Nov 03 17:22:05 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:06 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280" returned: 0 in 0.360s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:06 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280 Nov 03 17:22:06 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:06 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4/volume-b18970ac-c29c-4f66-9603-0e98f1acc280" returned: 0 in 0.256s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Lock "cinder-quobyte-b18970ac-c29c-4f66-9603-0e98f1acc280" released by "delete_volume" :: held 0.656s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG cinder.quota [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Created reservations ['f458537b-bf07-47fd-980b-c470ada284f1', 'bc478c37-8d23-4179-92c5-4c4691cbe250', '4ef6e4d1-050e-4217-a2a5-07ea2f0743ce', '7a7d2b41-9787-4407-8b4f-ec71b7f25394'] {{(pid=86661) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2': None} {{(pid=86661) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG cinder.volume.drivers.quobyte [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4a4eb6e-30c5-481b-94ae-018961db8fd2'] {{(pid=86661) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.lockutils [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86661) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 17:22:06 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4 Nov 03 17:22:06 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 17:22:06 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG oslo_concurrency.processutils [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/351f2d715a35e63c8129ee6610ad6ec4" returned: 0 in 0.281s {{(pid=86661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG cinder.manager [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Notifying Schedulers of capabilities ... {{(pid=86661) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 17:22:06 devstack cinder-volume[86661]: INFO cinder.volume.manager [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Deleted volume successfully. Nov 03 17:22:06 devstack cinder-volume[86661]: DEBUG cinder.coordination [None req-821f7bfe-fbbf-4f98-88b5-6ed7b11b2d49 tempest-ProjectReaderTests-42216747 None] Lock "cinder-b18970ac-c29c-4f66-9603-0e98f1acc280-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86661) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 17:22:16 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:SELECT=30,cinder:UPDATE=45,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 17:22:16 devstack cinder-volume[86661]: DEBUG dbcounter [-] [86661] Writing DB stats cinder:UPDATE=43,cinder:SELECT=26,cinder:DELETE=6,cinder:INSERT=10 {{(pid=86661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}